2023-10-01 21:01:16,820 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-01 21:01:17,026 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777 2023-10-01 21:01:17,026 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-01 21:01:17,026 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-01 21:01:17,062 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-01 21:01:17,302 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-01 21:01:17,302 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c, deleteOnExit=true 2023-10-01 21:01:17,303 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-01 21:01:17,303 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/test.cache.data in system properties and HBase conf 2023-10-01 21:01:17,303 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop.tmp.dir in system properties and HBase conf 2023-10-01 21:01:17,304 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop.log.dir in system properties and HBase conf 2023-10-01 21:01:17,304 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-01 21:01:17,304 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-01 21:01:17,305 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-01 21:01:17,622 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-01 21:01:17,626 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-01 21:01:17,627 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-01 21:01:17,627 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-01 21:01:17,627 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 21:01:17,628 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-01 21:01:17,628 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-01 21:01:17,628 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 21:01:17,628 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 21:01:17,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-01 21:01:17,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/nfs.dump.dir in system properties and HBase conf 2023-10-01 21:01:17,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/java.io.tmpdir in system properties and HBase conf 2023-10-01 21:01:17,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 21:01:17,630 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-01 21:01:17,630 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-01 21:01:18,128 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-01 21:01:18,133 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-01 21:01:18,464 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-01 21:01:18,633 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-01 21:01:18,647 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 21:01:18,684 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 21:01:18,720 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/java.io.tmpdir/Jetty_localhost_34571_hdfs____.184cjs/webapp 2023-10-01 21:01:18,870 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34571 2023-10-01 21:01:18,909 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-01 21:01:18,910 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-01 21:01:19,368 WARN [Listener at localhost/33955] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 21:01:19,441 WARN [Listener at localhost/33955] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 21:01:19,463 WARN [Listener at localhost/33955] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 21:01:19,471 INFO [Listener at localhost/33955] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 21:01:19,477 INFO [Listener at localhost/33955] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/java.io.tmpdir/Jetty_localhost_38573_datanode____.p7m1u5/webapp 2023-10-01 21:01:19,576 INFO [Listener at localhost/33955] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38573 2023-10-01 21:01:20,030 WARN [Listener at localhost/41771] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 21:01:20,052 WARN [Listener at localhost/41771] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 21:01:20,055 WARN [Listener at localhost/41771] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 21:01:20,058 INFO [Listener at localhost/41771] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 21:01:20,069 INFO [Listener at localhost/41771] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/java.io.tmpdir/Jetty_localhost_45859_datanode____dvfns2/webapp 2023-10-01 21:01:20,171 INFO [Listener at localhost/41771] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45859 2023-10-01 21:01:20,182 WARN [Listener at localhost/37039] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 21:01:20,202 WARN [Listener at localhost/37039] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-01 21:01:20,206 WARN [Listener at localhost/37039] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 21:01:20,208 INFO [Listener at localhost/37039] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 21:01:20,216 INFO [Listener at localhost/37039] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/java.io.tmpdir/Jetty_localhost_46229_datanode____mzch3y/webapp 2023-10-01 21:01:20,352 INFO [Listener at localhost/37039] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46229 2023-10-01 21:01:20,365 WARN [Listener at localhost/35805] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-01 21:01:20,642 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8059f70e22de43bc: Processing first storage report for DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4 from datanode 4b8192ed-0a19-48e1-aa82-f56e3505babc 2023-10-01 21:01:20,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8059f70e22de43bc: from storage DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4 node DatanodeRegistration(127.0.0.1:33315, datanodeUuid=4b8192ed-0a19-48e1-aa82-f56e3505babc, infoPort=43083, infoSecurePort=0, ipcPort=35805, storageInfo=lv=-57;cid=testClusterID;nsid=489076977;c=1696194078224), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-01 21:01:20,644 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa10ab2c3a73cbee: Processing first storage report for DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5 from datanode 74b202e7-f90f-4078-a7d6-1452e3860bc9 2023-10-01 21:01:20,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa10ab2c3a73cbee: from storage DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5 node DatanodeRegistration(127.0.0.1:33749, datanodeUuid=74b202e7-f90f-4078-a7d6-1452e3860bc9, infoPort=43009, infoSecurePort=0, ipcPort=37039, storageInfo=lv=-57;cid=testClusterID;nsid=489076977;c=1696194078224), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 21:01:20,644 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x52d7b7b3abc45bc: Processing first storage report for DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1 from datanode b2327866-66c0-4ea5-8cb3-b32e0cbe6400 2023-10-01 21:01:20,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x52d7b7b3abc45bc: from storage DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1 node DatanodeRegistration(127.0.0.1:36179, datanodeUuid=b2327866-66c0-4ea5-8cb3-b32e0cbe6400, infoPort=45357, infoSecurePort=0, ipcPort=41771, storageInfo=lv=-57;cid=testClusterID;nsid=489076977;c=1696194078224), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-01 21:01:20,645 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8059f70e22de43bc: Processing first storage report for DS-c5cb5e73-bc15-4084-8797-55595f0dc8d9 from datanode 4b8192ed-0a19-48e1-aa82-f56e3505babc 2023-10-01 21:01:20,645 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8059f70e22de43bc: from storage DS-c5cb5e73-bc15-4084-8797-55595f0dc8d9 node DatanodeRegistration(127.0.0.1:33315, datanodeUuid=4b8192ed-0a19-48e1-aa82-f56e3505babc, infoPort=43083, infoSecurePort=0, ipcPort=35805, storageInfo=lv=-57;cid=testClusterID;nsid=489076977;c=1696194078224), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 21:01:20,645 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa10ab2c3a73cbee: Processing first storage report for DS-8cfdb509-2bb1-4b38-9b6f-52af94c05871 from datanode 74b202e7-f90f-4078-a7d6-1452e3860bc9 2023-10-01 21:01:20,645 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa10ab2c3a73cbee: from storage DS-8cfdb509-2bb1-4b38-9b6f-52af94c05871 node DatanodeRegistration(127.0.0.1:33749, datanodeUuid=74b202e7-f90f-4078-a7d6-1452e3860bc9, infoPort=43009, infoSecurePort=0, ipcPort=37039, storageInfo=lv=-57;cid=testClusterID;nsid=489076977;c=1696194078224), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-01 21:01:20,645 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x52d7b7b3abc45bc: Processing first storage report for DS-8017e9d8-605c-4e32-9079-7644d24c44ac from datanode b2327866-66c0-4ea5-8cb3-b32e0cbe6400 2023-10-01 21:01:20,646 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x52d7b7b3abc45bc: from storage DS-8017e9d8-605c-4e32-9079-7644d24c44ac node DatanodeRegistration(127.0.0.1:36179, datanodeUuid=b2327866-66c0-4ea5-8cb3-b32e0cbe6400, infoPort=45357, infoSecurePort=0, ipcPort=41771, storageInfo=lv=-57;cid=testClusterID;nsid=489076977;c=1696194078224), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-01 21:01:20,873 DEBUG [Listener at localhost/35805] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777 2023-10-01 21:01:20,956 INFO [Listener at localhost/35805] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/zookeeper_0, clientPort=53257, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-01 21:01:20,974 INFO [Listener at localhost/35805] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53257 2023-10-01 21:01:20,981 INFO [Listener at localhost/35805] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:20,983 INFO [Listener at localhost/35805] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:21,664 INFO [Listener at localhost/35805] util.FSUtils(471): Created version file at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 with version=8 2023-10-01 21:01:21,665 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/hbase-staging 2023-10-01 21:01:22,064 INFO [Listener at localhost/35805] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-01 21:01:22,530 INFO [Listener at localhost/35805] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 21:01:22,563 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:22,563 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:22,563 INFO [Listener at localhost/35805] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 21:01:22,563 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:22,564 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 21:01:22,705 INFO [Listener at localhost/35805] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 21:01:22,778 DEBUG [Listener at localhost/35805] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-01 21:01:22,869 INFO [Listener at localhost/35805] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37567 2023-10-01 21:01:22,882 INFO [Listener at localhost/35805] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:22,884 INFO [Listener at localhost/35805] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:22,907 INFO [Listener at localhost/35805] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37567 connecting to ZooKeeper ensemble=127.0.0.1:53257 2023-10-01 21:01:22,959 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:375670x0, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 21:01:22,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37567-0x10103cae84f0000 connected 2023-10-01 21:01:22,993 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 21:01:22,994 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 21:01:23,006 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 21:01:23,014 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37567 2023-10-01 21:01:23,015 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37567 2023-10-01 21:01:23,015 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37567 2023-10-01 21:01:23,015 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37567 2023-10-01 21:01:23,016 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37567 2023-10-01 21:01:23,022 INFO [Listener at localhost/35805] master.HMaster(444): hbase.rootdir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89, hbase.cluster.distributed=false 2023-10-01 21:01:23,103 INFO [Listener at localhost/35805] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 21:01:23,103 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:23,103 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:23,103 INFO [Listener at localhost/35805] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 21:01:23,104 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:23,104 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 21:01:23,108 INFO [Listener at localhost/35805] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 21:01:23,111 INFO [Listener at localhost/35805] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35853 2023-10-01 21:01:23,114 INFO [Listener at localhost/35805] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 21:01:23,121 INFO [Listener at localhost/35805] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 21:01:23,122 INFO [Listener at localhost/35805] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:23,125 INFO [Listener at localhost/35805] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:23,128 INFO [Listener at localhost/35805] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35853 connecting to ZooKeeper ensemble=127.0.0.1:53257 2023-10-01 21:01:23,133 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:358530x0, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 21:01:23,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35853-0x10103cae84f0001 connected 2023-10-01 21:01:23,134 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 21:01:23,135 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 21:01:23,136 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 21:01:23,137 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35853 2023-10-01 21:01:23,137 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35853 2023-10-01 21:01:23,138 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35853 2023-10-01 21:01:23,138 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35853 2023-10-01 21:01:23,139 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35853 2023-10-01 21:01:23,151 INFO [Listener at localhost/35805] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 21:01:23,152 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:23,152 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:23,153 INFO [Listener at localhost/35805] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 21:01:23,153 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:23,153 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 21:01:23,153 INFO [Listener at localhost/35805] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 21:01:23,155 INFO [Listener at localhost/35805] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39185 2023-10-01 21:01:23,156 INFO [Listener at localhost/35805] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 21:01:23,157 INFO [Listener at localhost/35805] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 21:01:23,158 INFO [Listener at localhost/35805] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:23,161 INFO [Listener at localhost/35805] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:23,164 INFO [Listener at localhost/35805] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39185 connecting to ZooKeeper ensemble=127.0.0.1:53257 2023-10-01 21:01:23,168 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:391850x0, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 21:01:23,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39185-0x10103cae84f0002 connected 2023-10-01 21:01:23,169 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 21:01:23,170 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 21:01:23,171 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 21:01:23,171 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39185 2023-10-01 21:01:23,173 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39185 2023-10-01 21:01:23,173 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39185 2023-10-01 21:01:23,177 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39185 2023-10-01 21:01:23,177 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39185 2023-10-01 21:01:23,189 INFO [Listener at localhost/35805] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-01 21:01:23,189 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:23,189 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:23,189 INFO [Listener at localhost/35805] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-01 21:01:23,189 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-01 21:01:23,189 INFO [Listener at localhost/35805] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-01 21:01:23,190 INFO [Listener at localhost/35805] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-01 21:01:23,191 INFO [Listener at localhost/35805] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42573 2023-10-01 21:01:23,191 INFO [Listener at localhost/35805] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-01 21:01:23,192 INFO [Listener at localhost/35805] mob.MobFileCache(125): MobFileCache disabled 2023-10-01 21:01:23,193 INFO [Listener at localhost/35805] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:23,195 INFO [Listener at localhost/35805] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:23,196 INFO [Listener at localhost/35805] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42573 connecting to ZooKeeper ensemble=127.0.0.1:53257 2023-10-01 21:01:23,200 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:425730x0, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-01 21:01:23,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42573-0x10103cae84f0003 connected 2023-10-01 21:01:23,201 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 21:01:23,202 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 21:01:23,203 DEBUG [Listener at localhost/35805] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-01 21:01:23,205 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42573 2023-10-01 21:01:23,205 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42573 2023-10-01 21:01:23,209 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42573 2023-10-01 21:01:23,209 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42573 2023-10-01 21:01:23,210 DEBUG [Listener at localhost/35805] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42573 2023-10-01 21:01:23,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37567,1696194081862 2023-10-01 21:01:23,222 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-01 21:01:23,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37567,1696194081862 2023-10-01 21:01:23,244 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 21:01:23,244 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 21:01:23,244 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 21:01:23,244 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-01 21:01:23,244 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:01:23,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-01 21:01:23,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37567,1696194081862 from backup master directory 2023-10-01 21:01:23,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-01 21:01:23,252 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37567,1696194081862 2023-10-01 21:01:23,252 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-01 21:01:23,253 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 21:01:23,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37567,1696194081862 2023-10-01 21:01:23,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-01 21:01:23,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-01 21:01:23,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/hbase.id with ID: 571ddb72-3398-438b-8b78-ccfce1217744 2023-10-01 21:01:23,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-01 21:01:23,425 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:01:23,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0face903 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:23,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e0fe455, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:23,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-01 21:01:23,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-01 21:01:23,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-01 21:01:23,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-01 21:01:23,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-01 21:01:23,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-01 21:01:23,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 21:01:23,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/data/master/store-tmp 2023-10-01 21:01:23,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:23,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-01 21:01:23,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 21:01:23,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 21:01:23,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-01 21:01:23,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 21:01:23,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 21:01:23,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 21:01:23,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/WALs/jenkins-hbase4.apache.org,37567,1696194081862 2023-10-01 21:01:23,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37567%2C1696194081862, suffix=, logDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/WALs/jenkins-hbase4.apache.org,37567,1696194081862, archiveDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/oldWALs, maxLogs=10 2023-10-01 21:01:23,732 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33749,DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5,DISK] 2023-10-01 21:01:23,732 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33315,DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4,DISK] 2023-10-01 21:01:23,732 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36179,DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1,DISK] 2023-10-01 21:01:23,740 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-01 21:01:23,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/WALs/jenkins-hbase4.apache.org,37567,1696194081862/jenkins-hbase4.apache.org%2C37567%2C1696194081862.1696194083687 2023-10-01 21:01:23,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36179,DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1,DISK], DatanodeInfoWithStorage[127.0.0.1:33749,DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5,DISK], DatanodeInfoWithStorage[127.0.0.1:33315,DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4,DISK]] 2023-10-01 21:01:23,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-01 21:01:23,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:23,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 21:01:23,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 21:01:23,874 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-01 21:01:23,881 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-01 21:01:23,910 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-01 21:01:23,922 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:23,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-01 21:01:23,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-01 21:01:23,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-01 21:01:23,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:01:23,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64771069, jitterRate=-0.03483586013317108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:01:23,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 21:01:23,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-01 21:01:23,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-01 21:01:23,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-01 21:01:23,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-01 21:01:23,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-01 21:01:24,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-10-01 21:01:24,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-01 21:01:24,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-01 21:01:24,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-01 21:01:24,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-01 21:01:24,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-01 21:01:24,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-01 21:01:24,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-01 21:01:24,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-01 21:01:24,099 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:01:24,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-01 21:01:24,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-01 21:01:24,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-01 21:01:24,125 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 21:01:24,125 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 21:01:24,125 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 21:01:24,125 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-01 21:01:24,125 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:01:24,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37567,1696194081862, sessionid=0x10103cae84f0000, setting cluster-up flag (Was=false) 2023-10-01 21:01:24,146 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:01:24,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-01 21:01:24,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37567,1696194081862 2023-10-01 21:01:24,165 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:01:24,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-01 21:01:24,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37567,1696194081862 2023-10-01 21:01:24,174 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp 2023-10-01 21:01:24,214 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(951): ClusterId : 571ddb72-3398-438b-8b78-ccfce1217744 2023-10-01 21:01:24,215 INFO [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(951): ClusterId : 571ddb72-3398-438b-8b78-ccfce1217744 2023-10-01 21:01:24,214 INFO [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(951): ClusterId : 571ddb72-3398-438b-8b78-ccfce1217744 2023-10-01 21:01:24,221 DEBUG [RS:2;jenkins-hbase4:42573] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 21:01:24,221 DEBUG [RS:0;jenkins-hbase4:35853] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 21:01:24,221 DEBUG [RS:1;jenkins-hbase4:39185] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-01 21:01:24,229 DEBUG [RS:1;jenkins-hbase4:39185] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 21:01:24,229 DEBUG [RS:0;jenkins-hbase4:35853] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 21:01:24,229 DEBUG [RS:2;jenkins-hbase4:42573] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-01 21:01:24,229 DEBUG [RS:0;jenkins-hbase4:35853] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 21:01:24,229 DEBUG [RS:1;jenkins-hbase4:39185] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 21:01:24,230 DEBUG [RS:2;jenkins-hbase4:42573] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-01 21:01:24,233 DEBUG [RS:1;jenkins-hbase4:39185] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 21:01:24,233 DEBUG [RS:0;jenkins-hbase4:35853] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 21:01:24,233 DEBUG [RS:2;jenkins-hbase4:42573] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-01 21:01:24,241 DEBUG [RS:0;jenkins-hbase4:35853] zookeeper.ReadOnlyZKClient(139): Connect 0x19f992f5 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:24,241 DEBUG [RS:1;jenkins-hbase4:39185] zookeeper.ReadOnlyZKClient(139): Connect 0x0b405130 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:24,241 DEBUG [RS:2;jenkins-hbase4:42573] zookeeper.ReadOnlyZKClient(139): Connect 0x4c967409 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:24,250 DEBUG [RS:0;jenkins-hbase4:35853] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@173e6fba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:24,251 DEBUG [RS:1;jenkins-hbase4:39185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@587ae28, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:24,251 DEBUG [RS:0;jenkins-hbase4:35853] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1301f985, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 21:01:24,251 DEBUG [RS:1;jenkins-hbase4:39185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b83a40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 21:01:24,284 DEBUG [RS:2;jenkins-hbase4:42573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425193eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:24,285 DEBUG [RS:2;jenkins-hbase4:42573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@466e1f79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 21:01:24,311 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42573 2023-10-01 21:01:24,313 DEBUG [RS:0;jenkins-hbase4:35853] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35853 2023-10-01 21:01:24,314 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39185 2023-10-01 21:01:24,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-01 21:01:24,317 INFO [RS:2;jenkins-hbase4:42573] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 21:01:24,317 INFO [RS:0;jenkins-hbase4:35853] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 21:01:24,318 INFO [RS:2;jenkins-hbase4:42573] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 21:01:24,317 INFO [RS:1;jenkins-hbase4:39185] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-01 21:01:24,318 INFO [RS:0;jenkins-hbase4:35853] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 21:01:24,318 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 21:01:24,318 INFO [RS:1;jenkins-hbase4:39185] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-01 21:01:24,318 DEBUG [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 21:01:24,319 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-01 21:01:24,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:24,319 INFO [RS:0;jenkins-hbase4:35853] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:24,319 INFO [RS:1;jenkins-hbase4:39185] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:24,320 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 21:01:24,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-01 21:01:24,319 DEBUG [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 21:01:24,319 INFO [RS:2;jenkins-hbase4:42573] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:24,320 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1022): About to register with Master. 2023-10-01 21:01:24,323 INFO [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37567,1696194081862 with isa=jenkins-hbase4.apache.org/172.31.14.131:35853, startcode=1696194083102 2023-10-01 21:01:24,323 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37567,1696194081862 with isa=jenkins-hbase4.apache.org/172.31.14.131:39185, startcode=1696194083151 2023-10-01 21:01:24,323 INFO [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37567,1696194081862 with isa=jenkins-hbase4.apache.org/172.31.14.131:42573, startcode=1696194083188 2023-10-01 21:01:24,341 DEBUG [RS:0;jenkins-hbase4:35853] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 21:01:24,341 DEBUG [RS:1;jenkins-hbase4:39185] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 21:01:24,341 DEBUG [RS:2;jenkins-hbase4:42573] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-01 21:01:24,399 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40167, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 21:01:24,399 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36679, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 21:01:24,399 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41355, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-01 21:01:24,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-01 21:01:24,409 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37567] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 21:01:24,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 21:01:24,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 21:01:24,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 21:01:24,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-01 21:01:24,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-01 21:01:24,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 21:01:24,418 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37567] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 21:01:24,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,418 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37567] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-01 21:01:24,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696194114423 2023-10-01 21:01:24,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-01 21:01:24,435 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-01 21:01:24,436 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-01 21:01:24,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-01 21:01:24,442 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 21:01:24,446 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 21:01:24,446 DEBUG [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 21:01:24,447 WARN [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 21:01:24,446 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(2830): Master is not running yet 2023-10-01 21:01:24,447 WARN [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 21:01:24,447 WARN [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-01 21:01:24,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-01 21:01:24,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-01 21:01:24,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-01 21:01:24,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-01 21:01:24,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-01 21:01:24,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-01 21:01:24,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-01 21:01:24,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-01 21:01:24,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-01 21:01:24,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696194084458,5,FailOnTimeoutGroup] 2023-10-01 21:01:24,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696194084461,5,FailOnTimeoutGroup] 2023-10-01 21:01:24,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-01 21:01:24,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,489 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-01 21:01:24,490 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-01 21:01:24,490 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:01:24,512 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:24,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-01 21:01:24,516 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/info 2023-10-01 21:01:24,517 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-01 21:01:24,518 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:24,518 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-01 21:01:24,521 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/rep_barrier 2023-10-01 21:01:24,521 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-01 21:01:24,522 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:24,522 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-01 21:01:24,524 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/table 2023-10-01 21:01:24,525 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-01 21:01:24,526 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:24,527 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740 2023-10-01 21:01:24,528 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740 2023-10-01 21:01:24,532 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-01 21:01:24,534 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-01 21:01:24,538 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:01:24,539 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69601713, jitterRate=0.037146344780921936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-01 21:01:24,539 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-01 21:01:24,539 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-01 21:01:24,539 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-01 21:01:24,539 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-01 21:01:24,539 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-01 21:01:24,539 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-01 21:01:24,541 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-01 21:01:24,541 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-01 21:01:24,548 INFO [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37567,1696194081862 with isa=jenkins-hbase4.apache.org/172.31.14.131:35853, startcode=1696194083102 2023-10-01 21:01:24,548 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37567,1696194081862 with isa=jenkins-hbase4.apache.org/172.31.14.131:39185, startcode=1696194083151 2023-10-01 21:01:24,548 INFO [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37567,1696194081862 with isa=jenkins-hbase4.apache.org/172.31.14.131:42573, startcode=1696194083188 2023-10-01 21:01:24,550 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-01 21:01:24,550 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-01 21:01:24,555 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37567] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:24,561 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37567] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:24,561 DEBUG [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:01:24,562 DEBUG [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33955 2023-10-01 21:01:24,562 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37567] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:24,562 DEBUG [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 21:01:24,562 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:01:24,563 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33955 2023-10-01 21:01:24,563 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 21:01:24,564 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:01:24,564 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33955 2023-10-01 21:01:24,564 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-01 21:01:24,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-01 21:01:24,575 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 21:01:24,575 DEBUG [RS:1;jenkins-hbase4:39185] zookeeper.ZKUtil(162): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:24,575 DEBUG [RS:2;jenkins-hbase4:42573] zookeeper.ZKUtil(162): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:24,576 WARN [RS:1;jenkins-hbase4:39185] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 21:01:24,577 DEBUG [RS:0;jenkins-hbase4:35853] zookeeper.ZKUtil(162): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:24,576 WARN [RS:2;jenkins-hbase4:42573] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 21:01:24,577 INFO [RS:1;jenkins-hbase4:39185] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 21:01:24,577 INFO [RS:2;jenkins-hbase4:42573] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 21:01:24,577 WARN [RS:0;jenkins-hbase4:35853] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-01 21:01:24,578 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:24,578 INFO [RS:0;jenkins-hbase4:35853] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 21:01:24,578 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:24,578 DEBUG [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:24,578 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42573,1696194083188] 2023-10-01 21:01:24,578 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35853,1696194083102] 2023-10-01 21:01:24,578 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39185,1696194083151] 2023-10-01 21:01:24,585 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-01 21:01:24,591 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-01 21:01:24,596 DEBUG [RS:0;jenkins-hbase4:35853] zookeeper.ZKUtil(162): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:24,596 DEBUG [RS:1;jenkins-hbase4:39185] zookeeper.ZKUtil(162): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:24,596 DEBUG [RS:2;jenkins-hbase4:42573] zookeeper.ZKUtil(162): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:24,596 DEBUG [RS:0;jenkins-hbase4:35853] zookeeper.ZKUtil(162): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:24,596 DEBUG [RS:1;jenkins-hbase4:39185] zookeeper.ZKUtil(162): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:24,597 DEBUG [RS:2;jenkins-hbase4:42573] zookeeper.ZKUtil(162): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:24,597 DEBUG [RS:0;jenkins-hbase4:35853] zookeeper.ZKUtil(162): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:24,597 DEBUG [RS:1;jenkins-hbase4:39185] zookeeper.ZKUtil(162): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:24,597 DEBUG [RS:2;jenkins-hbase4:42573] zookeeper.ZKUtil(162): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:24,609 DEBUG [RS:0;jenkins-hbase4:35853] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 21:01:24,609 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 21:01:24,609 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-01 21:01:24,619 INFO [RS:1;jenkins-hbase4:39185] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 21:01:24,619 INFO [RS:2;jenkins-hbase4:42573] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 21:01:24,619 INFO [RS:0;jenkins-hbase4:35853] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-01 21:01:24,642 INFO [RS:0;jenkins-hbase4:35853] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 21:01:24,642 INFO [RS:2;jenkins-hbase4:42573] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 21:01:24,642 INFO [RS:1;jenkins-hbase4:39185] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-01 21:01:24,646 INFO [RS:0;jenkins-hbase4:35853] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 21:01:24,646 INFO [RS:2;jenkins-hbase4:42573] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 21:01:24,647 INFO [RS:0;jenkins-hbase4:35853] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,646 INFO [RS:1;jenkins-hbase4:39185] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-01 21:01:24,647 INFO [RS:2;jenkins-hbase4:42573] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,647 INFO [RS:1;jenkins-hbase4:39185] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,648 INFO [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 21:01:24,648 INFO [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 21:01:24,648 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-01 21:01:24,657 INFO [RS:0;jenkins-hbase4:35853] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,657 INFO [RS:1;jenkins-hbase4:39185] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,657 INFO [RS:2;jenkins-hbase4:42573] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,657 DEBUG [RS:0;jenkins-hbase4:35853] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:1;jenkins-hbase4:39185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:0;jenkins-hbase4:35853] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:1;jenkins-hbase4:39185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:0;jenkins-hbase4:35853] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:2;jenkins-hbase4:42573] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:0;jenkins-hbase4:35853] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:1;jenkins-hbase4:39185] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:0;jenkins-hbase4:35853] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:1;jenkins-hbase4:39185] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:0;jenkins-hbase4:35853] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 21:01:24,658 DEBUG [RS:1;jenkins-hbase4:39185] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,659 DEBUG [RS:0;jenkins-hbase4:35853] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,658 DEBUG [RS:2;jenkins-hbase4:42573] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,659 DEBUG [RS:0;jenkins-hbase4:35853] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,659 DEBUG [RS:2;jenkins-hbase4:42573] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,659 DEBUG [RS:0;jenkins-hbase4:35853] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,659 DEBUG [RS:1;jenkins-hbase4:39185] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 21:01:24,659 DEBUG [RS:0;jenkins-hbase4:35853] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,659 DEBUG [RS:1;jenkins-hbase4:39185] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,659 DEBUG [RS:2;jenkins-hbase4:42573] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,659 DEBUG [RS:1;jenkins-hbase4:39185] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,660 DEBUG [RS:2;jenkins-hbase4:42573] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,660 DEBUG [RS:1;jenkins-hbase4:39185] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,660 DEBUG [RS:2;jenkins-hbase4:42573] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-01 21:01:24,660 DEBUG [RS:1;jenkins-hbase4:39185] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,660 DEBUG [RS:2;jenkins-hbase4:42573] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,660 INFO [RS:0;jenkins-hbase4:35853] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,660 DEBUG [RS:2;jenkins-hbase4:42573] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,660 INFO [RS:0;jenkins-hbase4:35853] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,660 DEBUG [RS:2;jenkins-hbase4:42573] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,660 INFO [RS:0;jenkins-hbase4:35853] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,660 DEBUG [RS:2;jenkins-hbase4:42573] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-01 21:01:24,664 INFO [RS:1;jenkins-hbase4:39185] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,664 INFO [RS:1;jenkins-hbase4:39185] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,665 INFO [RS:1;jenkins-hbase4:39185] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,666 INFO [RS:2;jenkins-hbase4:42573] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,666 INFO [RS:2;jenkins-hbase4:42573] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,666 INFO [RS:2;jenkins-hbase4:42573] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,696 INFO [RS:0;jenkins-hbase4:35853] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 21:01:24,696 INFO [RS:2;jenkins-hbase4:42573] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 21:01:24,696 INFO [RS:1;jenkins-hbase4:39185] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-01 21:01:24,701 INFO [RS:2;jenkins-hbase4:42573] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42573,1696194083188-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,701 INFO [RS:0;jenkins-hbase4:35853] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35853,1696194083102-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,701 INFO [RS:1;jenkins-hbase4:39185] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39185,1696194083151-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:24,725 INFO [RS:2;jenkins-hbase4:42573] regionserver.Replication(203): jenkins-hbase4.apache.org,42573,1696194083188 started 2023-10-01 21:01:24,725 INFO [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42573,1696194083188, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42573, sessionid=0x10103cae84f0003 2023-10-01 21:01:24,725 INFO [RS:0;jenkins-hbase4:35853] regionserver.Replication(203): jenkins-hbase4.apache.org,35853,1696194083102 started 2023-10-01 21:01:24,725 INFO [RS:1;jenkins-hbase4:39185] regionserver.Replication(203): jenkins-hbase4.apache.org,39185,1696194083151 started 2023-10-01 21:01:24,725 INFO [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35853,1696194083102, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35853, sessionid=0x10103cae84f0001 2023-10-01 21:01:24,725 DEBUG [RS:2;jenkins-hbase4:42573] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 21:01:24,725 DEBUG [RS:0;jenkins-hbase4:35853] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 21:01:24,725 DEBUG [RS:2;jenkins-hbase4:42573] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:24,725 DEBUG [RS:0;jenkins-hbase4:35853] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:24,725 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39185,1696194083151, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39185, sessionid=0x10103cae84f0002 2023-10-01 21:01:24,726 DEBUG [RS:0;jenkins-hbase4:35853] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35853,1696194083102' 2023-10-01 21:01:24,727 DEBUG [RS:1;jenkins-hbase4:39185] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-01 21:01:24,727 DEBUG [RS:1;jenkins-hbase4:39185] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:24,726 DEBUG [RS:2;jenkins-hbase4:42573] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42573,1696194083188' 2023-10-01 21:01:24,727 DEBUG [RS:2;jenkins-hbase4:42573] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 21:01:24,727 DEBUG [RS:1;jenkins-hbase4:39185] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39185,1696194083151' 2023-10-01 21:01:24,727 DEBUG [RS:1;jenkins-hbase4:39185] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 21:01:24,727 DEBUG [RS:0;jenkins-hbase4:35853] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-01 21:01:24,728 DEBUG [RS:2;jenkins-hbase4:42573] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 21:01:24,728 DEBUG [RS:0;jenkins-hbase4:35853] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 21:01:24,728 DEBUG [RS:1;jenkins-hbase4:39185] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-01 21:01:24,728 DEBUG [RS:2;jenkins-hbase4:42573] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 21:01:24,728 DEBUG [RS:0;jenkins-hbase4:35853] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 21:01:24,728 DEBUG [RS:1;jenkins-hbase4:39185] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-01 21:01:24,728 DEBUG [RS:0;jenkins-hbase4:35853] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 21:01:24,728 DEBUG [RS:2;jenkins-hbase4:42573] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 21:01:24,729 DEBUG [RS:0;jenkins-hbase4:35853] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:24,728 DEBUG [RS:1;jenkins-hbase4:39185] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-01 21:01:24,729 DEBUG [RS:0;jenkins-hbase4:35853] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35853,1696194083102' 2023-10-01 21:01:24,729 DEBUG [RS:0;jenkins-hbase4:35853] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:24,729 DEBUG [RS:2;jenkins-hbase4:42573] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:24,729 DEBUG [RS:1;jenkins-hbase4:39185] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:24,729 DEBUG [RS:1;jenkins-hbase4:39185] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39185,1696194083151' 2023-10-01 21:01:24,729 DEBUG [RS:1;jenkins-hbase4:39185] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:24,729 DEBUG [RS:2;jenkins-hbase4:42573] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42573,1696194083188' 2023-10-01 21:01:24,730 DEBUG [RS:2;jenkins-hbase4:42573] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:24,730 DEBUG [RS:0;jenkins-hbase4:35853] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:24,730 DEBUG [RS:2;jenkins-hbase4:42573] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:24,730 DEBUG [RS:1;jenkins-hbase4:39185] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:24,730 DEBUG [RS:0;jenkins-hbase4:35853] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 21:01:24,731 INFO [RS:0;jenkins-hbase4:35853] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 21:01:24,731 INFO [RS:0;jenkins-hbase4:35853] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 21:01:24,731 DEBUG [RS:2;jenkins-hbase4:42573] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 21:01:24,731 INFO [RS:2;jenkins-hbase4:42573] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 21:01:24,731 INFO [RS:2;jenkins-hbase4:42573] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 21:01:24,732 DEBUG [RS:1;jenkins-hbase4:39185] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-01 21:01:24,732 INFO [RS:1;jenkins-hbase4:39185] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-01 21:01:24,733 INFO [RS:1;jenkins-hbase4:39185] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-01 21:01:24,743 DEBUG [jenkins-hbase4:37567] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-01 21:01:24,747 DEBUG [jenkins-hbase4:37567] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 21:01:24,752 DEBUG [jenkins-hbase4:37567] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 21:01:24,752 DEBUG [jenkins-hbase4:37567] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 21:01:24,752 DEBUG [jenkins-hbase4:37567] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 21:01:24,752 DEBUG [jenkins-hbase4:37567] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 21:01:24,755 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39185,1696194083151, state=OPENING 2023-10-01 21:01:24,763 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-01 21:01:24,764 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:01:24,765 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-01 21:01:24,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:01:24,842 INFO [RS:2;jenkins-hbase4:42573] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42573%2C1696194083188, suffix=, logDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,42573,1696194083188, archiveDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/oldWALs, maxLogs=32 2023-10-01 21:01:24,842 INFO [RS:1;jenkins-hbase4:39185] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39185%2C1696194083151, suffix=, logDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,39185,1696194083151, archiveDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/oldWALs, maxLogs=32 2023-10-01 21:01:24,842 INFO [RS:0;jenkins-hbase4:35853] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35853%2C1696194083102, suffix=, logDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,35853,1696194083102, archiveDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/oldWALs, maxLogs=32 2023-10-01 21:01:24,872 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33749,DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5,DISK] 2023-10-01 21:01:24,872 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33315,DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4,DISK] 2023-10-01 21:01:24,872 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33749,DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5,DISK] 2023-10-01 21:01:24,874 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33315,DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4,DISK] 2023-10-01 21:01:24,874 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36179,DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1,DISK] 2023-10-01 21:01:24,874 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33749,DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5,DISK] 2023-10-01 21:01:24,874 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36179,DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1,DISK] 2023-10-01 21:01:24,875 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33315,DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4,DISK] 2023-10-01 21:01:24,875 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36179,DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1,DISK] 2023-10-01 21:01:24,893 INFO [RS:0;jenkins-hbase4:35853] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,35853,1696194083102/jenkins-hbase4.apache.org%2C35853%2C1696194083102.1696194084847 2023-10-01 21:01:24,893 INFO [RS:2;jenkins-hbase4:42573] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,42573,1696194083188/jenkins-hbase4.apache.org%2C42573%2C1696194083188.1696194084847 2023-10-01 21:01:24,894 DEBUG [RS:0;jenkins-hbase4:35853] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33749,DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5,DISK], DatanodeInfoWithStorage[127.0.0.1:33315,DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4,DISK], DatanodeInfoWithStorage[127.0.0.1:36179,DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1,DISK]] 2023-10-01 21:01:24,897 DEBUG [RS:2;jenkins-hbase4:42573] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36179,DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1,DISK], DatanodeInfoWithStorage[127.0.0.1:33315,DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4,DISK], DatanodeInfoWithStorage[127.0.0.1:33749,DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5,DISK]] 2023-10-01 21:01:24,897 INFO [RS:1;jenkins-hbase4:39185] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,39185,1696194083151/jenkins-hbase4.apache.org%2C39185%2C1696194083151.1696194084847 2023-10-01 21:01:24,898 DEBUG [RS:1;jenkins-hbase4:39185] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33315,DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4,DISK], DatanodeInfoWithStorage[127.0.0.1:33749,DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5,DISK], DatanodeInfoWithStorage[127.0.0.1:36179,DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1,DISK]] 2023-10-01 21:01:24,954 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:24,956 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 21:01:24,960 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 21:01:24,973 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-01 21:01:24,973 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-01 21:01:24,976 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39185%2C1696194083151.meta, suffix=.meta, logDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,39185,1696194083151, archiveDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/oldWALs, maxLogs=32 2023-10-01 21:01:24,996 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33315,DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4,DISK] 2023-10-01 21:01:24,998 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33749,DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5,DISK] 2023-10-01 21:01:24,998 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36179,DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1,DISK] 2023-10-01 21:01:25,004 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,39185,1696194083151/jenkins-hbase4.apache.org%2C39185%2C1696194083151.meta.1696194084978.meta 2023-10-01 21:01:25,005 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33315,DS-a12477a4-6076-4ae5-a18e-f37cfa697cc4,DISK], DatanodeInfoWithStorage[127.0.0.1:33749,DS-58d9d6b3-1ef6-46e2-953e-c506e69b8fe5,DISK], DatanodeInfoWithStorage[127.0.0.1:36179,DS-e94fcdc4-e14d-4f1a-90c8-d951d72c83e1,DISK]] 2023-10-01 21:01:25,005 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-01 21:01:25,006 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-01 21:01:25,008 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:25,008 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-01 21:01:25,011 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-01 21:01:25,012 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-01 21:01:25,028 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-01 21:01:25,029 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:25,029 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-01 21:01:25,029 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-01 21:01:25,032 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-01 21:01:25,034 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/info 2023-10-01 21:01:25,034 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/info 2023-10-01 21:01:25,035 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-01 21:01:25,036 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:25,036 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-01 21:01:25,038 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/rep_barrier 2023-10-01 21:01:25,038 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/rep_barrier 2023-10-01 21:01:25,038 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-01 21:01:25,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:25,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-01 21:01:25,042 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/table 2023-10-01 21:01:25,042 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/table 2023-10-01 21:01:25,042 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-01 21:01:25,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:25,045 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740 2023-10-01 21:01:25,048 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740 2023-10-01 21:01:25,052 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-01 21:01:25,055 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-01 21:01:25,056 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65252064, jitterRate=-0.027668476104736328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-01 21:01:25,060 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-01 21:01:25,073 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696194084946 2023-10-01 21:01:25,090 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-01 21:01:25,092 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-01 21:01:25,092 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39185,1696194083151, state=OPEN 2023-10-01 21:01:25,095 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-01 21:01:25,095 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-01 21:01:25,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-01 21:01:25,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39185,1696194083151 in 327 msec 2023-10-01 21:01:25,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-01 21:01:25,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 536 msec 2023-10-01 21:01:25,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 781 msec 2023-10-01 21:01:25,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696194085110, completionTime=-1 2023-10-01 21:01:25,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-01 21:01:25,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-01 21:01:25,183 DEBUG [hconnection-0x67090907-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:25,186 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:25,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-01 21:01:25,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696194145207 2023-10-01 21:01:25,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696194205207 2023-10-01 21:01:25,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 96 msec 2023-10-01 21:01:25,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37567,1696194081862-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:25,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37567,1696194081862-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:25,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37567,1696194081862-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:25,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37567, period=300000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:25,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-01 21:01:25,280 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-01 21:01:25,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-01 21:01:25,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 21:01:25,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-01 21:01:25,311 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 21:01:25,316 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 21:01:25,342 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c 2023-10-01 21:01:25,345 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c empty. 2023-10-01 21:01:25,346 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c 2023-10-01 21:01:25,346 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-01 21:01:25,387 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-01 21:01:25,390 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d7de2271be8d0199690d4632c668f82c, NAME => 'hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:01:25,416 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:25,416 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d7de2271be8d0199690d4632c668f82c, disabling compactions & flushes 2023-10-01 21:01:25,416 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:01:25,416 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:01:25,416 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. after waiting 0 ms 2023-10-01 21:01:25,416 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:01:25,416 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:01:25,416 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d7de2271be8d0199690d4632c668f82c: 2023-10-01 21:01:25,421 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 21:01:25,438 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696194085424"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194085424"}]},"ts":"1696194085424"} 2023-10-01 21:01:25,464 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-01 21:01:25,466 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 21:01:25,470 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194085467"}]},"ts":"1696194085467"} 2023-10-01 21:01:25,475 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-01 21:01:25,480 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 21:01:25,481 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 21:01:25,481 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 21:01:25,481 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 21:01:25,481 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 21:01:25,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d7de2271be8d0199690d4632c668f82c, ASSIGN}] 2023-10-01 21:01:25,488 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d7de2271be8d0199690d4632c668f82c, ASSIGN 2023-10-01 21:01:25,489 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d7de2271be8d0199690d4632c668f82c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42573,1696194083188; forceNewPlan=false, retain=false 2023-10-01 21:01:25,642 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 21:01:25,643 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d7de2271be8d0199690d4632c668f82c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:25,643 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696194085642"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194085642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194085642"}]},"ts":"1696194085642"} 2023-10-01 21:01:25,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d7de2271be8d0199690d4632c668f82c, server=jenkins-hbase4.apache.org,42573,1696194083188}] 2023-10-01 21:01:25,803 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:25,804 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 21:01:25,807 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 21:01:25,814 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:01:25,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7de2271be8d0199690d4632c668f82c, NAME => 'hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c.', STARTKEY => '', ENDKEY => ''} 2023-10-01 21:01:25,815 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. service=AccessControlService 2023-10-01 21:01:25,815 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:25,816 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d7de2271be8d0199690d4632c668f82c 2023-10-01 21:01:25,816 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:25,816 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d7de2271be8d0199690d4632c668f82c 2023-10-01 21:01:25,816 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d7de2271be8d0199690d4632c668f82c 2023-10-01 21:01:25,819 INFO [StoreOpener-d7de2271be8d0199690d4632c668f82c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d7de2271be8d0199690d4632c668f82c 2023-10-01 21:01:25,821 DEBUG [StoreOpener-d7de2271be8d0199690d4632c668f82c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c/info 2023-10-01 21:01:25,821 DEBUG [StoreOpener-d7de2271be8d0199690d4632c668f82c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c/info 2023-10-01 21:01:25,822 INFO [StoreOpener-d7de2271be8d0199690d4632c668f82c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7de2271be8d0199690d4632c668f82c columnFamilyName info 2023-10-01 21:01:25,822 INFO [StoreOpener-d7de2271be8d0199690d4632c668f82c-1] regionserver.HStore(310): Store=d7de2271be8d0199690d4632c668f82c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:25,824 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c 2023-10-01 21:01:25,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c 2023-10-01 21:01:25,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d7de2271be8d0199690d4632c668f82c 2023-10-01 21:01:25,833 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:01:25,834 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d7de2271be8d0199690d4632c668f82c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64607551, jitterRate=-0.03727246820926666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:01:25,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d7de2271be8d0199690d4632c668f82c: 2023-10-01 21:01:25,836 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c., pid=6, masterSystemTime=1696194085803 2023-10-01 21:01:25,840 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:01:25,841 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:01:25,843 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d7de2271be8d0199690d4632c668f82c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:25,843 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696194085842"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194085842"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194085842"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194085842"}]},"ts":"1696194085842"} 2023-10-01 21:01:25,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-01 21:01:25,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d7de2271be8d0199690d4632c668f82c, server=jenkins-hbase4.apache.org,42573,1696194083188 in 197 msec 2023-10-01 21:01:25,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-01 21:01:25,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d7de2271be8d0199690d4632c668f82c, ASSIGN in 366 msec 2023-10-01 21:01:25,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 21:01:25,856 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194085856"}]},"ts":"1696194085856"} 2023-10-01 21:01:25,858 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-01 21:01:25,861 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 21:01:25,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 562 msec 2023-10-01 21:01:25,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-01 21:01:25,912 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-01 21:01:25,912 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:01:25,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:25,941 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:25,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-01 21:01:25,969 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-01 21:01:25,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-10-01 21:01:25,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-01 21:01:25,998 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-01 21:01:26,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-10-01 21:01:26,013 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-01 21:01:26,015 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-01 21:01:26,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.763sec 2023-10-01 21:01:26,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-01 21:01:26,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-01 21:01:26,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-01 21:01:26,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37567,1696194081862-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-01 21:01:26,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37567,1696194081862-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-01 21:01:26,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-01 21:01:26,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-01 21:01:26,045 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 21:01:26,046 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 21:01:26,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-01 21:01:26,049 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:01:26,050 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee empty. 2023-10-01 21:01:26,053 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:01:26,053 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-01 21:01:26,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 21:01:26,077 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-01 21:01:26,079 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec9b72c29d03ee09c3a25709c05e4bee, NAME => 'hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:01:26,100 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:26,100 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ec9b72c29d03ee09c3a25709c05e4bee, disabling compactions & flushes 2023-10-01 21:01:26,100 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:01:26,100 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:01:26,100 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. after waiting 0 ms 2023-10-01 21:01:26,100 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:01:26,101 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:01:26,101 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ec9b72c29d03ee09c3a25709c05e4bee: 2023-10-01 21:01:26,104 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 21:01:26,106 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696194086106"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194086106"}]},"ts":"1696194086106"} 2023-10-01 21:01:26,109 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-01 21:01:26,110 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 21:01:26,110 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194086110"}]},"ts":"1696194086110"} 2023-10-01 21:01:26,112 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-01 21:01:26,117 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 21:01:26,118 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 21:01:26,118 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 21:01:26,119 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 21:01:26,119 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 21:01:26,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ec9b72c29d03ee09c3a25709c05e4bee, ASSIGN}] 2023-10-01 21:01:26,121 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ec9b72c29d03ee09c3a25709c05e4bee, ASSIGN 2023-10-01 21:01:26,123 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ec9b72c29d03ee09c3a25709c05e4bee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39185,1696194083151; forceNewPlan=false, retain=false 2023-10-01 21:01:26,123 DEBUG [Listener at localhost/35805] zookeeper.ReadOnlyZKClient(139): Connect 0x51038fe2 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:26,128 DEBUG [Listener at localhost/35805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28ba846e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:26,141 DEBUG [hconnection-0x1044170-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:26,153 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:26,155 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37567,1696194081862 2023-10-01 21:01:26,155 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-01 21:01:26,155 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/test.cache.data in system properties and HBase conf 2023-10-01 21:01:26,155 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop.tmp.dir in system properties and HBase conf 2023-10-01 21:01:26,155 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop.log.dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/nfs.dump.dir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/java.io.tmpdir in system properties and HBase conf 2023-10-01 21:01:26,156 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-01 21:01:26,157 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-01 21:01:26,157 INFO [Listener at localhost/35805] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-01 21:01:26,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 21:01:26,273 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 21:01:26,274 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ec9b72c29d03ee09c3a25709c05e4bee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:26,274 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696194086274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194086274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194086274"}]},"ts":"1696194086274"} 2023-10-01 21:01:26,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ec9b72c29d03ee09c3a25709c05e4bee, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:01:26,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 21:01:26,439 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:01:26,439 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec9b72c29d03ee09c3a25709c05e4bee, NAME => 'hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee.', STARTKEY => '', ENDKEY => ''} 2023-10-01 21:01:26,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. service=AccessControlService 2023-10-01 21:01:26,440 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:26,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:01:26,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:26,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:01:26,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:01:26,443 INFO [StoreOpener-ec9b72c29d03ee09c3a25709c05e4bee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:01:26,445 DEBUG [StoreOpener-ec9b72c29d03ee09c3a25709c05e4bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee/l 2023-10-01 21:01:26,445 DEBUG [StoreOpener-ec9b72c29d03ee09c3a25709c05e4bee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee/l 2023-10-01 21:01:26,445 INFO [StoreOpener-ec9b72c29d03ee09c3a25709c05e4bee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec9b72c29d03ee09c3a25709c05e4bee columnFamilyName l 2023-10-01 21:01:26,446 INFO [StoreOpener-ec9b72c29d03ee09c3a25709c05e4bee-1] regionserver.HStore(310): Store=ec9b72c29d03ee09c3a25709c05e4bee/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:26,449 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:01:26,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:01:26,455 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:01:26,461 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:01:26,462 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec9b72c29d03ee09c3a25709c05e4bee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59386625, jitterRate=-0.11507032811641693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:01:26,463 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec9b72c29d03ee09c3a25709c05e4bee: 2023-10-01 21:01:26,465 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee., pid=11, masterSystemTime=1696194086431 2023-10-01 21:01:26,467 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:01:26,467 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:01:26,468 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ec9b72c29d03ee09c3a25709c05e4bee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:26,469 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696194086468"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194086468"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194086468"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194086468"}]},"ts":"1696194086468"} 2023-10-01 21:01:26,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-01 21:01:26,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ec9b72c29d03ee09c3a25709c05e4bee, server=jenkins-hbase4.apache.org,39185,1696194083151 in 195 msec 2023-10-01 21:01:26,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-01 21:01:26,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ec9b72c29d03ee09c3a25709c05e4bee, ASSIGN in 357 msec 2023-10-01 21:01:26,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 21:01:26,484 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194086484"}]},"ts":"1696194086484"} 2023-10-01 21:01:26,486 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-01 21:01:26,490 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 21:01:26,493 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 448 msec 2023-10-01 21:01:26,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-01 21:01:26,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-01 21:01:26,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-01 21:01:27,285 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 21:01:27,645 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 21:01:27,652 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36163_jobhistory____eydtuc/webapp 2023-10-01 21:01:27,814 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-01 21:01:27,814 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-01 21:01:27,814 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 21:01:27,817 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 21:01:27,900 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:28,236 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:28,541 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-01 21:01:28,570 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36163 2023-10-01 21:01:28,778 WARN [Listener at jenkins-hbase4.apache.org/40397] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 21:01:29,045 WARN [Listener at jenkins-hbase4.apache.org/40397] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 21:01:29,046 INFO [Listener at jenkins-hbase4.apache.org/40397] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 21:01:29,055 INFO [Listener at jenkins-hbase4.apache.org/40397] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34969_cluster____.a4um0n/webapp 2023-10-01 21:01:29,139 INFO [Listener at jenkins-hbase4.apache.org/40397] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 21:01:29,139 INFO [Listener at jenkins-hbase4.apache.org/40397] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-01 21:01:29,139 INFO [Listener at jenkins-hbase4.apache.org/40397] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 21:01:29,140 INFO [Listener at jenkins-hbase4.apache.org/40397] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 21:01:29,148 INFO [Listener at jenkins-hbase4.apache.org/40397] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:29,334 INFO [Listener at jenkins-hbase4.apache.org/40397] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:29,464 INFO [Listener at jenkins-hbase4.apache.org/40397] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:29,473 INFO [Listener at jenkins-hbase4.apache.org/40397] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34969 2023-10-01 21:01:29,947 WARN [Listener at jenkins-hbase4.apache.org/36079] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 21:01:29,970 WARN [Listener at jenkins-hbase4.apache.org/36079] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 21:01:29,971 INFO [Listener at jenkins-hbase4.apache.org/36079] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 21:01:29,977 INFO [Listener at jenkins-hbase4.apache.org/36079] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35263_node____.z7ih9x/webapp 2023-10-01 21:01:30,029 INFO [Listener at jenkins-hbase4.apache.org/36079] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-01 21:01:30,029 INFO [Listener at jenkins-hbase4.apache.org/36079] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 21:01:30,029 INFO [Listener at jenkins-hbase4.apache.org/36079] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 21:01:30,029 INFO [Listener at jenkins-hbase4.apache.org/36079] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 21:01:30,039 INFO [Listener at jenkins-hbase4.apache.org/36079] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:30,084 INFO [Listener at jenkins-hbase4.apache.org/36079] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:30,174 INFO [Listener at jenkins-hbase4.apache.org/36079] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:30,188 INFO [Listener at jenkins-hbase4.apache.org/36079] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35263 2023-10-01 21:01:30,367 WARN [Listener at jenkins-hbase4.apache.org/42645] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-01 21:01:30,375 WARN [Listener at jenkins-hbase4.apache.org/42645] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-01 21:01:30,376 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): jetty-6.1.26 2023-10-01 21:01:30,385 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43623_node____.85459m/webapp 2023-10-01 21:01:30,446 INFO [Listener at jenkins-hbase4.apache.org/42645] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-01 21:01:30,447 INFO [Listener at jenkins-hbase4.apache.org/42645] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-01 21:01:30,447 INFO [Listener at jenkins-hbase4.apache.org/42645] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-01 21:01:30,447 INFO [Listener at jenkins-hbase4.apache.org/42645] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-01 21:01:30,455 INFO [Listener at jenkins-hbase4.apache.org/42645] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:30,468 INFO [Listener at jenkins-hbase4.apache.org/42645] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:30,534 INFO [Listener at jenkins-hbase4.apache.org/42645] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-01 21:01:30,539 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43623 2023-10-01 21:01:30,561 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-01 21:01:30,562 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:01:30,574 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 21:01:30,639 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=125, ProcessCount=167, AvailableMemoryMB=2552 2023-10-01 21:01:30,645 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-10-01 21:01:30,664 DEBUG [Listener at jenkins-hbase4.apache.org/42645] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-01 21:01:30,670 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-01 21:01:30,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 21:01:30,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-01 21:01:30,686 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 21:01:30,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-01 21:01:30,689 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 21:01:30,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 21:01:30,694 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:30,694 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:30,695 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2 empty. 2023-10-01 21:01:30,696 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b empty. 2023-10-01 21:01:30,696 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:30,697 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:30,697 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-01 21:01:30,748 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-01 21:01:30,753 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => b1dcc57c954f6724cb7adca6c30e0f9b, NAME => 'testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:01:30,754 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => bdec3c91c0b1da506415a010f053afe2, NAME => 'testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:01:30,788 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-01 21:01:30,796 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-01 21:01:30,797 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-01 21:01:30,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 21:01:30,813 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:30,813 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing bdec3c91c0b1da506415a010f053afe2, disabling compactions & flushes 2023-10-01 21:01:30,813 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:30,813 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:30,813 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. after waiting 0 ms 2023-10-01 21:01:30,813 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:30,813 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:30,814 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for bdec3c91c0b1da506415a010f053afe2: 2023-10-01 21:01:30,814 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:30,814 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing b1dcc57c954f6724cb7adca6c30e0f9b, disabling compactions & flushes 2023-10-01 21:01:30,814 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:30,815 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:30,815 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. after waiting 0 ms 2023-10-01 21:01:30,815 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:30,815 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:30,815 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for b1dcc57c954f6724cb7adca6c30e0f9b: 2023-10-01 21:01:30,819 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 21:01:30,820 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696194090820"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194090820"}]},"ts":"1696194090820"} 2023-10-01 21:01:30,821 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696194090820"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194090820"}]},"ts":"1696194090820"} 2023-10-01 21:01:30,869 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 21:01:30,870 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 21:01:30,871 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194090871"}]},"ts":"1696194090871"} 2023-10-01 21:01:30,873 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-01 21:01:30,880 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 21:01:30,881 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 21:01:30,882 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 21:01:30,882 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 21:01:30,882 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 21:01:30,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1dcc57c954f6724cb7adca6c30e0f9b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bdec3c91c0b1da506415a010f053afe2, ASSIGN}] 2023-10-01 21:01:30,885 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bdec3c91c0b1da506415a010f053afe2, ASSIGN 2023-10-01 21:01:30,885 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1dcc57c954f6724cb7adca6c30e0f9b, ASSIGN 2023-10-01 21:01:30,886 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bdec3c91c0b1da506415a010f053afe2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35853,1696194083102; forceNewPlan=false, retain=false 2023-10-01 21:01:30,886 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1dcc57c954f6724cb7adca6c30e0f9b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39185,1696194083151; forceNewPlan=false, retain=false 2023-10-01 21:01:31,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 21:01:31,036 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 21:01:31,039 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b1dcc57c954f6724cb7adca6c30e0f9b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:31,039 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=bdec3c91c0b1da506415a010f053afe2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:31,039 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696194091039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194091039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194091039"}]},"ts":"1696194091039"} 2023-10-01 21:01:31,039 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696194091039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194091039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194091039"}]},"ts":"1696194091039"} 2023-10-01 21:01:31,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure b1dcc57c954f6724cb7adca6c30e0f9b, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:01:31,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure bdec3c91c0b1da506415a010f053afe2, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:01:31,198 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:31,199 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 21:01:31,202 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 21:01:31,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:31,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1dcc57c954f6724cb7adca6c30e0f9b, NAME => 'testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 21:01:31,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. service=AccessControlService 2023-10-01 21:01:31,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:31,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:31,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:31,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:31,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:31,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:31,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bdec3c91c0b1da506415a010f053afe2, NAME => 'testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 21:01:31,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. service=AccessControlService 2023-10-01 21:01:31,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:31,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:31,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:31,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:31,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:31,215 INFO [StoreOpener-b1dcc57c954f6724cb7adca6c30e0f9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:31,215 INFO [StoreOpener-bdec3c91c0b1da506415a010f053afe2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:31,220 DEBUG [StoreOpener-b1dcc57c954f6724cb7adca6c30e0f9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/cf 2023-10-01 21:01:31,220 DEBUG [StoreOpener-b1dcc57c954f6724cb7adca6c30e0f9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/cf 2023-10-01 21:01:31,220 DEBUG [StoreOpener-bdec3c91c0b1da506415a010f053afe2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/cf 2023-10-01 21:01:31,220 DEBUG [StoreOpener-bdec3c91c0b1da506415a010f053afe2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/cf 2023-10-01 21:01:31,224 INFO [StoreOpener-b1dcc57c954f6724cb7adca6c30e0f9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1dcc57c954f6724cb7adca6c30e0f9b columnFamilyName cf 2023-10-01 21:01:31,224 INFO [StoreOpener-bdec3c91c0b1da506415a010f053afe2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdec3c91c0b1da506415a010f053afe2 columnFamilyName cf 2023-10-01 21:01:31,226 INFO [StoreOpener-bdec3c91c0b1da506415a010f053afe2-1] regionserver.HStore(310): Store=bdec3c91c0b1da506415a010f053afe2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:31,227 INFO [StoreOpener-b1dcc57c954f6724cb7adca6c30e0f9b-1] regionserver.HStore(310): Store=b1dcc57c954f6724cb7adca6c30e0f9b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:31,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:31,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:31,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:31,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:31,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:31,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:31,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:01:31,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:01:31,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b1dcc57c954f6724cb7adca6c30e0f9b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62655941, jitterRate=-0.06635372340679169}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:01:31,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bdec3c91c0b1da506415a010f053afe2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70301044, jitterRate=0.04756718873977661}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:01:31,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b1dcc57c954f6724cb7adca6c30e0f9b: 2023-10-01 21:01:31,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bdec3c91c0b1da506415a010f053afe2: 2023-10-01 21:01:31,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2., pid=16, masterSystemTime=1696194091198 2023-10-01 21:01:31,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b., pid=15, masterSystemTime=1696194091196 2023-10-01 21:01:31,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:31,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:31,258 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b1dcc57c954f6724cb7adca6c30e0f9b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:31,258 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696194091257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194091257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194091257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194091257"}]},"ts":"1696194091257"} 2023-10-01 21:01:31,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:31,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:31,260 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=bdec3c91c0b1da506415a010f053afe2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:31,261 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696194091260"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194091260"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194091260"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194091260"}]},"ts":"1696194091260"} 2023-10-01 21:01:31,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-01 21:01:31,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure b1dcc57c954f6724cb7adca6c30e0f9b, server=jenkins-hbase4.apache.org,39185,1696194083151 in 220 msec 2023-10-01 21:01:31,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-01 21:01:31,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure bdec3c91c0b1da506415a010f053afe2, server=jenkins-hbase4.apache.org,35853,1696194083102 in 221 msec 2023-10-01 21:01:31,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1dcc57c954f6724cb7adca6c30e0f9b, ASSIGN in 384 msec 2023-10-01 21:01:31,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-01 21:01:31,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bdec3c91c0b1da506415a010f053afe2, ASSIGN in 386 msec 2023-10-01 21:01:31,273 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 21:01:31,273 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194091273"}]},"ts":"1696194091273"} 2023-10-01 21:01:31,275 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-01 21:01:31,278 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 21:01:31,283 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-01 21:01:31,299 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 21:01:31,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 21:01:31,335 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:31,335 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:31,335 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:31,335 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:31,335 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:01:31,344 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 21:01:31,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 21:01:31,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 21:01:31,345 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 21:01:31,345 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-01 21:01:31,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 664 msec 2023-10-01 21:01:31,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-01 21:01:31,815 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-01 21:01:31,819 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-01 21:01:31,820 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:31,822 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:01:31,847 DEBUG [hconnection-0x1044170-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:31,852 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:31,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 21:01:31,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194091868 (current time:1696194091868). 2023-10-01 21:01:31,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:01:31,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x6877833b to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:31,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12e99d77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:31,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:31,879 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:31,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6877833b to 127.0.0.1:53257 2023-10-01 21:01:31,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:01:31,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x4b09b861 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:31,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@607f5610, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:31,890 DEBUG [hconnection-0x5c2a33cb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:31,893 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:31,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b09b861 to 127.0.0.1:53257 2023-10-01 21:01:31,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:01:31,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 21:01:31,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:01:31,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 21:01:31,938 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:01:31,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 21:01:31,959 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 21:01:31,960 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696194691960 2023-10-01 21:01:31,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 21:01:31,960 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-01 21:01:31,964 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 21:01:31,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 21:01:31,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-10-01 21:01:31,966 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 21:01:31,967 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:01:31,967 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696194691967 2023-10-01 21:01:31,968 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:01:31,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:31,997 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-01 21:01:31,997 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:31,998 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-01 21:01:31,998 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-01 21:01:31,999 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:31,999 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,009 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:32,009 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:32,009 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:32,009 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:32,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:32,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:32,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:32,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:32,010 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,010 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,010 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,010 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:01:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 21:01:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 21:01:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-01 21:01:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 21:01:32,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 21:01:32,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 21:01:32,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,018 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 21:01:32,018 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 21:01:32,018 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 21:01:32,018 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:32,018 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:32,019 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 21:01:32,018 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:32,020 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 21:01:32,020 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 21:01:32,020 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 21:01:32,021 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 21:01:32,020 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 21:01:32,021 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-01 21:01:32,021 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 21:01:32,021 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-01 21:01:32,023 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,023 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:32,024 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,024 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:32,024 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,024 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,024 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:32,024 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,024 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:32,024 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:32,024 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:32,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-01 21:01:32,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fca4009[Count = 1] remaining members to acquire global barrier 2023-10-01 21:01:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:32,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-01 21:01:32,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fca4009[Count = 0] remaining members to acquire global barrier 2023-10-01 21:01:32,030 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-01 21:01:32,030 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,032 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,032 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,032 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,033 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,032 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 21:01:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,033 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 21:01:32,033 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 21:01:32,033 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 21:01:32,033 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,033 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:01:32,033 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:01:32,034 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:01:32,034 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:01:32,035 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:32,035 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. started... 2023-10-01 21:01:32,039 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:01:32,039 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:01:32,039 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:32,039 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. started... 2023-10-01 21:01:32,039 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 21:01:32,039 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:32,039 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 21:01:32,042 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1dcc57c954f6724cb7adca6c30e0f9b: 2023-10-01 21:01:32,042 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bdec3c91c0b1da506415a010f053afe2: 2023-10-01 21:01:32,043 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,043 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,048 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:01:32,048 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:01:32,051 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:01:32,051 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:01:32,060 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:01:32,062 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-01 21:01:32,062 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:01:32,062 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-01 21:01:32,063 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-01 21:01:32,063 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-01 21:01:32,063 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:01:32,063 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-01 21:01:32,063 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-01 21:01:32,063 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-01 21:01:32,068 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:01:32,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 21:01:32,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:01:32,091 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. completed. 2023-10-01 21:01:32,091 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 21:01:32,091 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:32,092 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:01:32,092 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:01:32,092 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,092 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 21:01:32,092 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:01:32,093 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. completed. 2023-10-01 21:01:32,093 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:32,093 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:01:32,093 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:01:32,094 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,094 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-01 21:01:32,094 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:01:32,095 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,095 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 21:01:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:32,095 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:32,095 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 21:01:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 21:01:32,096 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-01 21:01:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:32,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39185,1696194083151': 2023-10-01 21:01:32,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-01 21:01:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:32,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:01:32,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-01 21:01:32,107 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-01 21:01:32,107 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:01:32,107 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:01:32,107 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,107 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:01:32,110 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,110 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,110 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:32,110 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,110 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:32,110 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:32,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:32,111 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,111 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:32,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:32,112 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,112 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,114 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:32,115 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,115 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,130 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,130 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:32,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:32,130 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:32,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:32,130 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,131 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:32,131 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:32,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:32,131 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,131 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,131 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,131 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,131 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:32,131 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:32,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:32,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:32,131 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:32,131 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,132 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-01 21:01:32,131 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:32,133 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,133 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:01:32,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:32,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:32,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 21:01:32,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-01 21:01:32,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,202 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:32,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696194091961Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696194092150 (+189 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696194092150Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696194092150Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696194092165 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696194092189 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696194092202 (+13 ms) 2023-10-01 21:01:32,204 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 21:01:32,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 242 msec 2023-10-01 21:01:32,291 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:01:32,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 21:01:32,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:01:32,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39185] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:01:32,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35853] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:01:32,317 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-01 21:01:32,318 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:32,318 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:01:32,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 21:01:32,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194092333 (current time:1696194092333). 2023-10-01 21:01:32,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:01:32,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x36c54d68 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:32,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47bf25df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:32,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:32,343 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:32,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36c54d68 to 127.0.0.1:53257 2023-10-01 21:01:32,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:01:32,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x3c922bcf to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:32,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20a09f38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:32,351 DEBUG [hconnection-0x1e0fd72e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:32,353 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:32,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c922bcf to 127.0.0.1:53257 2023-10-01 21:01:32,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:01:32,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-01 21:01:32,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:01:32,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 21:01:32,363 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:01:32,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 21:01:32,366 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 21:01:32,367 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696194692367 2023-10-01 21:01:32,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-01 21:01:32,367 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-01 21:01:32,368 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:01:32,369 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:01:32,370 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-01 21:01:32,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 21:01:32,372 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-01 21:01:32,372 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 21:01:32,373 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696194692373 2023-10-01 21:01:32,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-01 21:01:32,389 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-01 21:01:32,389 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:32,390 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-01 21:01:32,390 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-01 21:01:32,390 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,390 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,392 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:32,392 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:32,392 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:32,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:32,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:32,392 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:32,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:32,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:32,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:32,393 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,393 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,393 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,393 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:01:32,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 21:01:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 21:01:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,394 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 21:01:32,394 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 21:01:32,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 21:01:32,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 21:01:32,397 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 21:01:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-01 21:01:32,397 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:32,397 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 21:01:32,398 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 21:01:32,398 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 21:01:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 21:01:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 21:01:32,399 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-01 21:01:32,398 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 21:01:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 21:01:32,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-01 21:01:32,400 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-01 21:01:32,400 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:32,400 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-01 21:01:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-01 21:01:32,401 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-01 21:01:32,402 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:32,402 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,403 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:32,403 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,404 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,405 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 21:01:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:32,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-01 21:01:32,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2466c3ec[Count = 1] remaining members to acquire global barrier 2023-10-01 21:01:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 21:01:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:32,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-01 21:01:32,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2466c3ec[Count = 0] remaining members to acquire global barrier 2023-10-01 21:01:32,410 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-01 21:01:32,410 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,414 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,414 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,414 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 21:01:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 21:01:32,415 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:01:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:01:32,415 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-01 21:01:32,415 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. started... 2023-10-01 21:01:32,415 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:32,415 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,415 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. started... 2023-10-01 21:01:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 21:01:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:01:32,415 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bdec3c91c0b1da506415a010f053afe2 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-01 21:01:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:01:32,415 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:01:32,415 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b1dcc57c954f6724cb7adca6c30e0f9b 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-01 21:01:32,415 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:01:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 21:01:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:32,418 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 21:01:32,469 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:01:32,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 21:01:32,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:01:32,470 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 21:01:32,544 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001357d530670b94a51b050edcb4f073e19 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001357d530670b94a51b050edcb4f073e19 2023-10-01 21:01:32,544 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310011405dffdf5174d7bbdce545fe595b549 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310011405dffdf5174d7bbdce545fe595b549 2023-10-01 21:01:32,592 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/.tmp/cf/10bc1f5964654aa195f993ee129df255 2023-10-01 21:01:32,601 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/.tmp/cf/10bc1f5964654aa195f993ee129df255 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/cf/10bc1f5964654aa195f993ee129df255 2023-10-01 21:01:32,610 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/cf/10bc1f5964654aa195f993ee129df255, entries=4, sequenceid=6, filesize=5.6 K 2023-10-01 21:01:32,612 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b1dcc57c954f6724cb7adca6c30e0f9b in 197ms, sequenceid=6, compaction requested=false 2023-10-01 21:01:32,612 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-01 21:01:32,614 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1dcc57c954f6724cb7adca6c30e0f9b: 2023-10-01 21:01:32,614 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 21:01:32,614 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:01:32,614 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/cf/10bc1f5964654aa195f993ee129df255] hfiles 2023-10-01 21:01:32,614 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/cf/10bc1f5964654aa195f993ee129df255 for snapshot=snaptb0-testExportWithTargetName 2023-10-01 21:01:32,632 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. completed. 2023-10-01 21:01:32,632 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:32,633 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:01:32,633 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:01:32,633 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,633 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 21:01:32,633 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:01:32,635 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 21:01:32,635 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,635 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:32,635 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 21:01:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 21:01:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:32,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 21:01:32,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:32,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:32,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39185,1696194083151': 2023-10-01 21:01:32,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-01 21:01:32,671 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:01:32,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 21:01:32,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:01:32,672 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-01 21:01:32,972 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:01:32,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 21:01:32,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:01:32,974 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-01 21:01:32,992 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/.tmp/cf/af1de641ae72427b9640e9b7b565e0d8 2023-10-01 21:01:33,001 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/.tmp/cf/af1de641ae72427b9640e9b7b565e0d8 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/cf/af1de641ae72427b9640e9b7b565e0d8 2023-10-01 21:01:33,009 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/cf/af1de641ae72427b9640e9b7b565e0d8, entries=46, sequenceid=6, filesize=12.6 K 2023-10-01 21:01:33,012 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for bdec3c91c0b1da506415a010f053afe2 in 596ms, sequenceid=6, compaction requested=false 2023-10-01 21:01:33,013 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bdec3c91c0b1da506415a010f053afe2: 2023-10-01 21:01:33,013 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 21:01:33,013 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:01:33,013 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/cf/af1de641ae72427b9640e9b7b565e0d8] hfiles 2023-10-01 21:01:33,013 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/cf/af1de641ae72427b9640e9b7b565e0d8 for snapshot=snaptb0-testExportWithTargetName 2023-10-01 21:01:33,028 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. completed. 2023-10-01 21:01:33,028 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:33,028 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:01:33,029 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:01:33,029 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,029 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-01 21:01:33,029 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:01:33,031 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,031 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-01 21:01:33,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:33,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:33,031 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:33,031 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-01 21:01:33,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:33,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:33,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 21:01:33,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:33,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:33,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:33,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 21:01:33,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:33,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:33,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:01:33,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-01 21:01:33,036 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-01 21:01:33,036 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:01:33,036 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:01:33,037 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-01 21:01:33,037 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:01:33,040 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,040 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,040 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:33,040 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:33,040 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,040 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:33,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:33,040 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:33,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,040 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:33,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:33,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:33,041 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:33,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 21:01:33,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:33,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:33,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:33,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,042 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 21:01:33,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:33,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:33,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:33,044 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-01 21:01:33,045 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:33,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,045 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:33,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:33,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:33,057 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:33,057 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:33,057 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:33,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:33,057 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:33,057 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,057 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:33,057 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:33,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:33,057 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:33,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:33,057 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:33,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-01 21:01:33,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:33,058 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-01 21:01:33,058 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:33,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:33,058 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:33,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-01 21:01:33,059 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:01:33,059 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:33,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:33,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:33,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:33,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:33,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:33,059 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:33,060 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:33,060 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:33,060 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,060 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001357d530670b94a51b050edcb4f073e19, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310011405dffdf5174d7bbdce545fe595b549] mob files 2023-10-01 21:01:33,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001357d530670b94a51b050edcb4f073e19 2023-10-01 21:01:33,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310011405dffdf5174d7bbdce545fe595b549 2023-10-01 21:01:33,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-01 21:01:33,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,119 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-01 21:01:33,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,120 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-01 21:01:33,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696194092367Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696194093074 (+707 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696194093074Loading Region manifests for snaptb0-testExportWithTargetName at 1696194093074Writing data manifest for snaptb0-testExportWithTargetName at 1696194093082 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696194093107 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696194093119 (+12 ms) 2023-10-01 21:01:33,122 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-01 21:01:33,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 755 msec 2023-10-01 21:01:33,474 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:01:33,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-01 21:01:33,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:01:33,477 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194093477 2023-10-01 21:01:33,478 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33955, tgtDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194093477, rawTgtDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194093477, srcFsUri=hdfs://localhost:33955, srcDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:01:33,521 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:01:33,521 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_952938294_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194093477, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194093477/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-01 21:01:33,521 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89, snapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-01 21:01:33,540 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194093477/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-01 21:01:33,609 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:33,610 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:33,610 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:33,611 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:34,525 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-2338579848809383087.jar 2023-10-01 21:01:34,525 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:34,526 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:34,598 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-5084486578129972794.jar 2023-10-01 21:01:34,599 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:34,599 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:34,600 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:34,600 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:34,600 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:34,601 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:34,601 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 21:01:34,602 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 21:01:34,602 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 21:01:34,603 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 21:01:34,603 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 21:01:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 21:01:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 21:01:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 21:01:34,605 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 21:01:34,606 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 21:01:34,610 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:01:34,611 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:01:34,612 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:01:34,612 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:01:34,612 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:01:34,613 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:01:34,614 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:01:35,458 WARN [Listener at jenkins-hbase4.apache.org/42645] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 21:01:35,464 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-01 21:01:35,472 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-01 21:01:35,918 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:01:35,920 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:01:36,478 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0001_000001 (auth:SIMPLE) 2023-10-01 21:01:36,712 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 21:01:40,815 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0001_000001 (auth:SIMPLE) 2023-10-01 21:01:43,083 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0001_000001 (auth:SIMPLE) 2023-10-01 21:01:45,718 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0001_000001 (auth:SIMPLE) 2023-10-01 21:01:47,303 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 21:01:47,306 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 21:01:47,320 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-01 21:01:47,320 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 21:01:47,321 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 21:01:47,321 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-01 21:01:47,322 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-01 21:01:47,322 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-01 21:01:47,322 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194093477/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194093477/.hbase-snapshot/testExportWithTargetName 2023-10-01 21:01:47,322 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194093477/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-01 21:01:47,322 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194093477/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-01 21:01:47,336 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-01 21:01:47,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-01 21:01:47,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-01 21:01:47,356 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194107356"}]},"ts":"1696194107356"} 2023-10-01 21:01:47,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 21:01:47,358 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-01 21:01:47,360 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-01 21:01:47,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1dcc57c954f6724cb7adca6c30e0f9b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bdec3c91c0b1da506415a010f053afe2, UNASSIGN}] 2023-10-01 21:01:47,364 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1dcc57c954f6724cb7adca6c30e0f9b, UNASSIGN 2023-10-01 21:01:47,364 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bdec3c91c0b1da506415a010f053afe2, UNASSIGN 2023-10-01 21:01:47,365 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b1dcc57c954f6724cb7adca6c30e0f9b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:47,365 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=bdec3c91c0b1da506415a010f053afe2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:47,365 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696194107365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194107365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194107365"}]},"ts":"1696194107365"} 2023-10-01 21:01:47,365 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696194107365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194107365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194107365"}]},"ts":"1696194107365"} 2023-10-01 21:01:47,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure b1dcc57c954f6724cb7adca6c30e0f9b, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:01:47,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure bdec3c91c0b1da506415a010f053afe2, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:01:47,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 21:01:47,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:47,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:47,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bdec3c91c0b1da506415a010f053afe2, disabling compactions & flushes 2023-10-01 21:01:47,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b1dcc57c954f6724cb7adca6c30e0f9b, disabling compactions & flushes 2023-10-01 21:01:47,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:47,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:47,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:47,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:47,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. after waiting 0 ms 2023-10-01 21:01:47,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. after waiting 0 ms 2023-10-01 21:01:47,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:47,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:47,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:01:47,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:01:47,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:01:47,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:01:47,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b. 2023-10-01 21:01:47,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2. 2023-10-01 21:01:47,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b1dcc57c954f6724cb7adca6c30e0f9b: 2023-10-01 21:01:47,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bdec3c91c0b1da506415a010f053afe2: 2023-10-01 21:01:47,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:47,548 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b1dcc57c954f6724cb7adca6c30e0f9b, regionState=CLOSED 2023-10-01 21:01:47,548 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696194107548"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194107548"}]},"ts":"1696194107548"} 2023-10-01 21:01:47,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:47,549 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=bdec3c91c0b1da506415a010f053afe2, regionState=CLOSED 2023-10-01 21:01:47,549 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696194107549"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194107549"}]},"ts":"1696194107549"} 2023-10-01 21:01:47,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-01 21:01:47,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure b1dcc57c954f6724cb7adca6c30e0f9b, server=jenkins-hbase4.apache.org,39185,1696194083151 in 183 msec 2023-10-01 21:01:47,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-01 21:01:47,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure bdec3c91c0b1da506415a010f053afe2, server=jenkins-hbase4.apache.org,35853,1696194083102 in 183 msec 2023-10-01 21:01:47,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1dcc57c954f6724cb7adca6c30e0f9b, UNASSIGN in 192 msec 2023-10-01 21:01:47,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-01 21:01:47,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=bdec3c91c0b1da506415a010f053afe2, UNASSIGN in 195 msec 2023-10-01 21:01:47,559 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194107559"}]},"ts":"1696194107559"} 2023-10-01 21:01:47,561 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-01 21:01:47,562 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-01 21:01:47,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 219 msec 2023-10-01 21:01:47,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-01 21:01:47,660 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-01 21:01:47,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-01 21:01:47,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 21:01:47,676 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 21:01:47,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-01 21:01:47,679 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 21:01:47,682 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-01 21:01:47,685 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:47,685 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:47,686 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 21:01:47,686 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 21:01:47,686 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 21:01:47,686 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 21:01:47,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-01 21:01:47,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-01 21:01:47,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-01 21:01:47,687 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 21:01:47,687 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 21:01:47,687 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-01 21:01:47,688 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-01 21:01:47,688 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:47,688 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:47,688 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:47,687 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:47,688 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 21:01:47,690 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/recovered.edits] 2023-10-01 21:01:47,690 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/recovered.edits] 2023-10-01 21:01:47,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-01 21:01:47,698 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/cf/af1de641ae72427b9640e9b7b565e0d8 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/cf/af1de641ae72427b9640e9b7b565e0d8 2023-10-01 21:01:47,698 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/cf/10bc1f5964654aa195f993ee129df255 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/cf/10bc1f5964654aa195f993ee129df255 2023-10-01 21:01:47,702 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b/recovered.edits/9.seqid 2023-10-01 21:01:47,702 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2/recovered.edits/9.seqid 2023-10-01 21:01:47,703 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/b1dcc57c954f6724cb7adca6c30e0f9b 2023-10-01 21:01:47,703 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportWithTargetName/bdec3c91c0b1da506415a010f053afe2 2023-10-01 21:01:47,703 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-01 21:01:47,704 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-01 21:01:47,705 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-01 21:01:47,709 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001357d530670b94a51b050edcb4f073e19 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231001357d530670b94a51b050edcb4f073e19 2023-10-01 21:01:47,710 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310011405dffdf5174d7bbdce545fe595b549 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310011405dffdf5174d7bbdce545fe595b549 2023-10-01 21:01:47,711 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-01 21:01:47,713 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 21:01:47,734 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-01 21:01:47,737 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-01 21:01:47,739 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 21:01:47,739 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-01 21:01:47,739 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194107739"}]},"ts":"9223372036854775807"} 2023-10-01 21:01:47,739 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194107739"}]},"ts":"9223372036854775807"} 2023-10-01 21:01:47,741 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 21:01:47,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b1dcc57c954f6724cb7adca6c30e0f9b, NAME => 'testtb-testExportWithTargetName,,1696194090680.b1dcc57c954f6724cb7adca6c30e0f9b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bdec3c91c0b1da506415a010f053afe2, NAME => 'testtb-testExportWithTargetName,1,1696194090680.bdec3c91c0b1da506415a010f053afe2.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 21:01:47,741 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-01 21:01:47,742 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696194107741"}]},"ts":"9223372036854775807"} 2023-10-01 21:01:47,746 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-01 21:01:47,748 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-01 21:01:47,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 82 msec 2023-10-01 21:01:47,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-01 21:01:47,795 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-01 21:01:47,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-01 21:01:47,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-01 21:01:47,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-01 21:01:47,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-01 21:01:47,851 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 707) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:36079 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-567930497_1 at /127.0.0.1:57726 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:44028 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:38473 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:60414 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:57752 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:40997 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 125) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=1789 (was 2552) 2023-10-01 21:01:47,851 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-10-01 21:01:47,869 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=170, AvailableMemoryMB=1788 2023-10-01 21:01:47,869 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-10-01 21:01:47,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 21:01:47,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-01 21:01:47,876 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 21:01:47,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-01 21:01:47,878 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 21:01:47,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 21:01:47,881 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:01:47,881 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:01:47,881 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9 empty. 2023-10-01 21:01:47,882 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b empty. 2023-10-01 21:01:47,882 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:01:47,882 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:01:47,882 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-01 21:01:47,894 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-01 21:01:47,896 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5fda66460f71f95d9f18efc7c15ffaa9, NAME => 'testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:01:47,896 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 900a43eaa6440b304c042081ba0e3a4b, NAME => 'testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:01:47,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:47,924 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5fda66460f71f95d9f18efc7c15ffaa9, disabling compactions & flushes 2023-10-01 21:01:47,924 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:47,924 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:47,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 900a43eaa6440b304c042081ba0e3a4b, disabling compactions & flushes 2023-10-01 21:01:47,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:47,925 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:47,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. after waiting 0 ms 2023-10-01 21:01:47,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:47,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:47,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. after waiting 0 ms 2023-10-01 21:01:47,925 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:47,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5fda66460f71f95d9f18efc7c15ffaa9: 2023-10-01 21:01:47,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:47,925 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:47,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 900a43eaa6440b304c042081ba0e3a4b: 2023-10-01 21:01:47,929 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 21:01:47,930 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696194107929"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194107929"}]},"ts":"1696194107929"} 2023-10-01 21:01:47,930 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696194107929"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194107929"}]},"ts":"1696194107929"} 2023-10-01 21:01:47,933 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 21:01:47,934 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 21:01:47,934 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194107934"}]},"ts":"1696194107934"} 2023-10-01 21:01:47,936 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-01 21:01:47,940 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 21:01:47,941 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 21:01:47,941 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 21:01:47,942 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 21:01:47,942 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 21:01:47,942 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5fda66460f71f95d9f18efc7c15ffaa9, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=900a43eaa6440b304c042081ba0e3a4b, ASSIGN}] 2023-10-01 21:01:47,945 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=900a43eaa6440b304c042081ba0e3a4b, ASSIGN 2023-10-01 21:01:47,945 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5fda66460f71f95d9f18efc7c15ffaa9, ASSIGN 2023-10-01 21:01:47,946 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5fda66460f71f95d9f18efc7c15ffaa9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42573,1696194083188; forceNewPlan=false, retain=false 2023-10-01 21:01:47,946 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=900a43eaa6440b304c042081ba0e3a4b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35853,1696194083102; forceNewPlan=false, retain=false 2023-10-01 21:01:47,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 21:01:48,096 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 21:01:48,100 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=900a43eaa6440b304c042081ba0e3a4b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,100 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5fda66460f71f95d9f18efc7c15ffaa9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,100 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696194108099"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194108099"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194108099"}]},"ts":"1696194108099"} 2023-10-01 21:01:48,100 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696194108099"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194108099"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194108099"}]},"ts":"1696194108099"} 2023-10-01 21:01:48,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 900a43eaa6440b304c042081ba0e3a4b, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:01:48,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 5fda66460f71f95d9f18efc7c15ffaa9, server=jenkins-hbase4.apache.org,42573,1696194083188}] 2023-10-01 21:01:48,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 21:01:48,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:48,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 900a43eaa6440b304c042081ba0e3a4b, NAME => 'testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 21:01:48,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. service=AccessControlService 2023-10-01 21:01:48,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:48,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:01:48,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:48,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:01:48,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:01:48,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:48,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5fda66460f71f95d9f18efc7c15ffaa9, NAME => 'testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 21:01:48,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. service=AccessControlService 2023-10-01 21:01:48,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:01:48,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:01:48,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:01:48,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:01:48,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:01:48,267 INFO [StoreOpener-900a43eaa6440b304c042081ba0e3a4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:01:48,268 INFO [StoreOpener-5fda66460f71f95d9f18efc7c15ffaa9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:01:48,268 DEBUG [StoreOpener-900a43eaa6440b304c042081ba0e3a4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/cf 2023-10-01 21:01:48,268 DEBUG [StoreOpener-900a43eaa6440b304c042081ba0e3a4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/cf 2023-10-01 21:01:48,269 INFO [StoreOpener-900a43eaa6440b304c042081ba0e3a4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900a43eaa6440b304c042081ba0e3a4b columnFamilyName cf 2023-10-01 21:01:48,269 DEBUG [StoreOpener-5fda66460f71f95d9f18efc7c15ffaa9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/cf 2023-10-01 21:01:48,269 DEBUG [StoreOpener-5fda66460f71f95d9f18efc7c15ffaa9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/cf 2023-10-01 21:01:48,269 INFO [StoreOpener-5fda66460f71f95d9f18efc7c15ffaa9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fda66460f71f95d9f18efc7c15ffaa9 columnFamilyName cf 2023-10-01 21:01:48,270 INFO [StoreOpener-900a43eaa6440b304c042081ba0e3a4b-1] regionserver.HStore(310): Store=900a43eaa6440b304c042081ba0e3a4b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:48,271 INFO [StoreOpener-5fda66460f71f95d9f18efc7c15ffaa9-1] regionserver.HStore(310): Store=5fda66460f71f95d9f18efc7c15ffaa9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:01:48,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:01:48,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:01:48,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:01:48,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:01:48,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:01:48,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:01:48,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:01:48,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 900a43eaa6440b304c042081ba0e3a4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73295960, jitterRate=0.09219491481781006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:01:48,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 900a43eaa6440b304c042081ba0e3a4b: 2023-10-01 21:01:48,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:01:48,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5fda66460f71f95d9f18efc7c15ffaa9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64780141, jitterRate=-0.034700676798820496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:01:48,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5fda66460f71f95d9f18efc7c15ffaa9: 2023-10-01 21:01:48,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b., pid=30, masterSystemTime=1696194108255 2023-10-01 21:01:48,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9., pid=31, masterSystemTime=1696194108256 2023-10-01 21:01:48,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:48,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:48,283 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=900a43eaa6440b304c042081ba0e3a4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,283 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696194108283"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194108283"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194108283"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194108283"}]},"ts":"1696194108283"} 2023-10-01 21:01:48,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:48,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:48,285 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5fda66460f71f95d9f18efc7c15ffaa9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,286 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696194108285"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194108285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194108285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194108285"}]},"ts":"1696194108285"} 2023-10-01 21:01:48,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-01 21:01:48,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 900a43eaa6440b304c042081ba0e3a4b, server=jenkins-hbase4.apache.org,35853,1696194083102 in 184 msec 2023-10-01 21:01:48,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-01 21:01:48,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 5fda66460f71f95d9f18efc7c15ffaa9, server=jenkins-hbase4.apache.org,42573,1696194083188 in 185 msec 2023-10-01 21:01:48,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=900a43eaa6440b304c042081ba0e3a4b, ASSIGN in 347 msec 2023-10-01 21:01:48,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-01 21:01:48,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5fda66460f71f95d9f18efc7c15ffaa9, ASSIGN in 350 msec 2023-10-01 21:01:48,296 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 21:01:48,296 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194108296"}]},"ts":"1696194108296"} 2023-10-01 21:01:48,298 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-01 21:01:48,304 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 21:01:48,304 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-01 21:01:48,306 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 21:01:48,307 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:48,307 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:48,307 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:48,307 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:01:48,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 21:01:48,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 21:01:48,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 21:01:48,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 21:01:48,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 438 msec 2023-10-01 21:01:48,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-01 21:01:48,483 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-01 21:01:48,486 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-01 21:01:48,486 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:48,489 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:01:48,497 DEBUG [hconnection-0x1044170-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:48,499 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:48,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:01:48,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194108505 (current time:1696194108505). 2023-10-01 21:01:48,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:01:48,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x1e76bb7f to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:48,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ff12a55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:48,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:48,515 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:48,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e76bb7f to 127.0.0.1:53257 2023-10-01 21:01:48,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:01:48,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x45d2219f to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:48,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e54d719, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:48,529 DEBUG [hconnection-0x891eb04-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:48,530 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:48,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45d2219f to 127.0.0.1:53257 2023-10-01 21:01:48,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:01:48,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 21:01:48,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:01:48,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:01:48,539 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:01:48,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:01:48,541 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:01:48,542 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696194708542 2023-10-01 21:01:48,542 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-01 21:01:48,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:01:48,543 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:01:48,544 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:01:48,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 21:01:48,545 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:01:48,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-01 21:01:48,547 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 21:01:48,548 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696194708548 2023-10-01 21:01:48,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,568 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-01 21:01:48,568 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:48,569 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-01 21:01:48,569 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-01 21:01:48,570 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,570 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,571 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:48,571 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:48,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:48,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:48,571 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,571 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:48,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:48,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:48,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:48,572 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,572 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,572 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,572 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:01:48,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,573 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 21:01:48,573 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,575 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 21:01:48,575 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 21:01:48,575 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 21:01:48,575 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 21:01:48,575 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:48,575 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 21:01:48,576 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 21:01:48,576 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 21:01:48,575 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:48,576 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 21:01:48,577 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 21:01:48,577 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-01 21:01:48,577 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-01 21:01:48,578 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,578 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:48,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:48,585 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,585 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,585 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,585 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:48,585 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:48,585 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,585 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,585 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:48,585 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:48,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:48,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:48,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-01 21:01:48,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50699ecc[Count = 1] remaining members to acquire global barrier 2023-10-01 21:01:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:48,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-01 21:01:48,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50699ecc[Count = 0] remaining members to acquire global barrier 2023-10-01 21:01:48,590 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 21:01:48,590 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,591 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,591 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,591 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:01:48,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 21:01:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:01:48,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,592 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:01:48,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:01:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:01:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:01:48,592 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:01:48,592 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. started... 2023-10-01 21:01:48,592 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,592 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:48,592 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:01:48,593 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. started... 2023-10-01 21:01:48,593 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5fda66460f71f95d9f18efc7c15ffaa9: 2023-10-01 21:01:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:01:48,594 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 900a43eaa6440b304c042081ba0e3a4b: 2023-10-01 21:01:48,594 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,594 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,594 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:01:48,594 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:01:48,594 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:01:48,594 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:01:48,594 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 21:01:48,594 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:48,594 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 21:01:48,627 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. completed. 2023-10-01 21:01:48,627 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:48,627 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:01:48,627 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:01:48,627 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,627 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 21:01:48,627 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:01:48,627 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. completed. 2023-10-01 21:01:48,628 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:48,628 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:01:48,628 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:01:48,628 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,628 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-01 21:01:48,628 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:01:48,629 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,629 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 21:01:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:48,629 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:48,629 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 21:01:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:48,632 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 21:01:48,632 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:48,632 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:48,632 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-01 21:01:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42573,1696194083188': 2023-10-01 21:01:48,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 21:01:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:48,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:01:48,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 21:01:48,641 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-01 21:01:48,641 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:01:48,641 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:01:48,641 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,641 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:01:48,643 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,643 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:48,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,643 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,643 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:48,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,643 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:48,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,643 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,643 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:48,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:48,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:48,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:48,644 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,644 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:01:48,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:48,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:48,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:48,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:48,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:48,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,644 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,645 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 21:01:48,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:01:48,645 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 21:01:48,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:48,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,647 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,647 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:48,648 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,651 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,651 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:48,651 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:48,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:48,651 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:48,651 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:48,651 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:48,651 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,651 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:48,653 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,653 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:48,653 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:48,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:48,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:48,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:48,651 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:48,651 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,653 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,653 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-01 21:01:48,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:48,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:48,653 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:48,654 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:48,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:01:48,654 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,654 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,654 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:48,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:48,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 21:01:48,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,696 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-01 21:01:48,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,697 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-01 21:01:48,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696194108542Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696194108663 (+121 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696194108663Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696194108664 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696194108669 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696194108688 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696194108696 (+8 ms) 2023-10-01 21:01:48,699 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 21:01:48,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 156 msec 2023-10-01 21:01:48,846 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-01 21:01:48,847 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:01:48,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 21:01:48,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:01:48,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42573] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:01:48,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35853] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:01:48,859 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-01 21:01:48,859 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:48,859 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:01:48,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:01:48,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194108872 (current time:1696194108872). 2023-10-01 21:01:48,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:01:48,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x7a177820 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:48,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b163937, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:48,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:48,885 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:48,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a177820 to 127.0.0.1:53257 2023-10-01 21:01:48,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:01:48,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x4db48c2d to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:01:48,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@669674f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:01:48,894 DEBUG [hconnection-0x2236b4c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:01:48,896 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:01:48,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4db48c2d to 127.0.0.1:53257 2023-10-01 21:01:48,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:01:48,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 21:01:48,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:01:48,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:01:48,904 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:01:48,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:01:48,907 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:01:48,908 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696194708908 2023-10-01 21:01:48,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:01:48,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-01 21:01:48,909 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:01:48,909 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:01:48,910 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:01:48,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 21:01:48,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-01 21:01:48,912 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 21:01:48,913 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696194708913 2023-10-01 21:01:48,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-01 21:01:48,928 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-01 21:01:48,928 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:48,929 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-01 21:01:48,929 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-01 21:01:48,930 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,930 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,931 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:48,931 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:48,931 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:48,931 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:48,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:48,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:48,931 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,931 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:48,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,932 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,932 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:01:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 21:01:48,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,933 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 21:01:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 21:01:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-01 21:01:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,933 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 21:01:48,933 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-01 21:01:48,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 21:01:48,933 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 21:01:48,933 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:48,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 21:01:48,933 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 21:01:48,934 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:48,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-01 21:01:48,934 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 21:01:48,935 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-01 21:01:48,935 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:01:48,935 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 21:01:48,936 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-01 21:01:48,936 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 21:01:48,936 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 21:01:48,935 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-01 21:01:48,936 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 21:01:48,936 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 21:01:48,936 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-01 21:01:48,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,939 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:48,940 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,940 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:48,940 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,940 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,940 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:48,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:48,940 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,940 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:48,940 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,941 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:01:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 21:01:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:48,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-01 21:01:48,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@802ba6[Count = 1] remaining members to acquire global barrier 2023-10-01 21:01:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:48,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:48,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:48,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:48,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 21:01:48,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:48,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:48,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-01 21:01:48,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@802ba6[Count = 0] remaining members to acquire global barrier 2023-10-01 21:01:48,944 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 21:01:48,945 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,945 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,946 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,946 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,946 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:01:48,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,946 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:48,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:48,946 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:01:48,946 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:01:48,946 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:01:48,946 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:48,946 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 21:01:48,946 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:48,946 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:48,946 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. started... 2023-10-01 21:01:48,946 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. started... 2023-10-01 21:01:48,946 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:01:48,947 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:01:48,946 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:01:48,947 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 900a43eaa6440b304c042081ba0e3a4b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-01 21:01:48,947 INFO [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5fda66460f71f95d9f18efc7c15ffaa9 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-01 21:01:48,946 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:01:48,946 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:01:48,948 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 21:01:48,948 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:48,948 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 21:01:48,976 INFO [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310019e420fe0a20a4aeeab16ae468ccaa26a to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310019e420fe0a20a4aeeab16ae468ccaa26a 2023-10-01 21:01:48,988 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310010c8b9db1c8ac4abb884b7154318fcc1f to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310010c8b9db1c8ac4abb884b7154318fcc1f 2023-10-01 21:01:49,001 INFO [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/.tmp/cf/ce5709379ce34ef9a4d9a9b8e170136e 2023-10-01 21:01:49,009 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:01:49,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 21:01:49,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:01:49,011 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 21:01:49,013 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/.tmp/cf/ce5709379ce34ef9a4d9a9b8e170136e as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/cf/ce5709379ce34ef9a4d9a9b8e170136e 2023-10-01 21:01:49,017 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/.tmp/cf/3b09626baacd45fd82c2d08d7e705f67 2023-10-01 21:01:49,021 INFO [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/cf/ce5709379ce34ef9a4d9a9b8e170136e, entries=2, sequenceid=6, filesize=5.2 K 2023-10-01 21:01:49,022 INFO [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 5fda66460f71f95d9f18efc7c15ffaa9 in 75ms, sequenceid=6, compaction requested=false 2023-10-01 21:01:49,024 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5fda66460f71f95d9f18efc7c15ffaa9: 2023-10-01 21:01:49,024 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 21:01:49,024 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:01:49,024 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/cf/ce5709379ce34ef9a4d9a9b8e170136e] hfiles 2023-10-01 21:01:49,024 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/cf/ce5709379ce34ef9a4d9a9b8e170136e for snapshot=snaptb0-testExportFileSystemState 2023-10-01 21:01:49,026 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/.tmp/cf/3b09626baacd45fd82c2d08d7e705f67 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/cf/3b09626baacd45fd82c2d08d7e705f67 2023-10-01 21:01:49,036 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/cf/3b09626baacd45fd82c2d08d7e705f67, entries=48, sequenceid=6, filesize=13.0 K 2023-10-01 21:01:49,037 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 900a43eaa6440b304c042081ba0e3a4b in 90ms, sequenceid=6, compaction requested=false 2023-10-01 21:01:49,037 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 900a43eaa6440b304c042081ba0e3a4b: 2023-10-01 21:01:49,037 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 21:01:49,037 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:01:49,037 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/cf/3b09626baacd45fd82c2d08d7e705f67] hfiles 2023-10-01 21:01:49,037 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/cf/3b09626baacd45fd82c2d08d7e705f67 for snapshot=snaptb0-testExportFileSystemState 2023-10-01 21:01:49,045 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. completed. 2023-10-01 21:01:49,045 DEBUG [rs(jenkins-hbase4.apache.org,42573,1696194083188)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:01:49,045 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:01:49,045 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:01:49,045 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,045 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 21:01:49,045 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:01:49,079 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,079 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 21:01:49,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:49,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:49,079 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:49,079 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 21:01:49,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:49,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:49,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 21:01:49,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:49,084 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. completed. 2023-10-01 21:01:49,084 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:01:49,084 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:01:49,084 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:01:49,084 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:49,084 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-01 21:01:49,084 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:01:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 21:01:49,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,085 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,085 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-01 21:01:49,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:49,085 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:49,085 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-01 21:01:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42573,1696194083188': 2023-10-01 21:01:49,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 21:01:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:49,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:49,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:49,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 21:01:49,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:49,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:49,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 21:01:49,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:49,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:01:49,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 21:01:49,091 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-01 21:01:49,091 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:01:49,091 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:01:49,091 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-01 21:01:49,091 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:01:49,093 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,093 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,093 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,093 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,093 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:01:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:01:49,093 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:49,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,093 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:49,094 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:01:49,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:49,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:49,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,095 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 21:01:49,095 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:49,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:01:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 21:01:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:01:49,097 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-01 21:01:49,097 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,098 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:49,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:49,100 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:49,100 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:49,100 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:49,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:49,100 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:49,101 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:49,101 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,101 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:01:49,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-01 21:01:49,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:49,101 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:49,101 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,101 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:01:49,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:01:49,101 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:01:49,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:49,101 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:01:49,103 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:01:49,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:49,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:49,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-01 21:01:49,103 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,103 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:01:49,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-01 21:01:49,103 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:01:49,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:49,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:49,103 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:01:49,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:01:49,103 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:01:49,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310010c8b9db1c8ac4abb884b7154318fcc1f, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310019e420fe0a20a4aeeab16ae468ccaa26a] mob files 2023-10-01 21:01:49,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310010c8b9db1c8ac4abb884b7154318fcc1f 2023-10-01 21:01:49,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310019e420fe0a20a4aeeab16ae468ccaa26a 2023-10-01 21:01:49,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-01 21:01:49,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,142 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-01 21:01:49,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,143 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696194108908Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696194109117 (+209 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696194109117Loading Region manifests for snaptb0-testExportFileSystemState at 1696194109117Writing data manifest for snaptb0-testExportFileSystemState at 1696194109121 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696194109133 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696194109142 (+9 ms) 2023-10-01 21:01:49,145 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-01 21:01:49,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 236 msec 2023-10-01 21:01:49,211 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:01:49,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 21:01:49,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:01:49,212 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194109212 2023-10-01 21:01:49,212 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33955, tgtDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194109212, rawTgtDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194109212, srcFsUri=hdfs://localhost:33955, srcDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:01:49,235 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:01:49,235 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1538900139_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194109212, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194109212/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,235 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89, snapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-01 21:01:49,252 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194109212/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-01 21:01:49,278 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:49,279 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:49,279 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:49,279 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:50,179 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-3262508099827102287.jar 2023-10-01 21:01:50,179 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:50,180 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:50,250 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-2431191194501505595.jar 2023-10-01 21:01:50,251 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:50,251 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:50,252 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:50,252 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:50,252 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:50,253 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 21:01:50,253 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 21:01:50,254 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 21:01:50,254 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 21:01:50,254 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 21:01:50,255 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 21:01:50,255 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 21:01:50,256 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 21:01:50,256 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 21:01:50,256 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 21:01:50,257 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 21:01:50,257 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:01:50,258 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:01:50,258 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:01:50,259 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:01:50,259 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:01:50,259 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:01:50,260 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:01:50,711 WARN [Listener at jenkins-hbase4.apache.org/42645] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 21:01:50,714 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-01 21:01:50,716 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-01 21:01:51,913 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:01:51,913 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:01:51,919 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0001_000001 (auth:SIMPLE) 2023-10-01 21:01:52,572 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0002_000001 (auth:SIMPLE) 2023-10-01 21:01:53,143 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 21:01:56,750 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0002_000001 (auth:SIMPLE) 2023-10-01 21:01:58,984 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0002_000001 (auth:SIMPLE) 2023-10-01 21:02:02,157 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0002_000001 (auth:SIMPLE) 2023-10-01 21:02:03,973 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 21:02:03,974 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 21:02:03,982 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-01 21:02:03,982 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 21:02:03,983 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 21:02:03,983 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 21:02:03,983 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-01 21:02:03,983 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-01 21:02:03,983 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194109212/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194109212/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-01 21:02:03,984 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194109212/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-01 21:02:03,984 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194109212/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-01 21:02:03,991 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-01 21:02:03,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-01 21:02:03,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-01 21:02:03,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 21:02:03,997 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194123996"}]},"ts":"1696194123996"} 2023-10-01 21:02:03,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-01 21:02:04,000 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-01 21:02:04,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5fda66460f71f95d9f18efc7c15ffaa9, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=900a43eaa6440b304c042081ba0e3a4b, UNASSIGN}] 2023-10-01 21:02:04,003 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5fda66460f71f95d9f18efc7c15ffaa9, UNASSIGN 2023-10-01 21:02:04,003 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=900a43eaa6440b304c042081ba0e3a4b, UNASSIGN 2023-10-01 21:02:04,003 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5fda66460f71f95d9f18efc7c15ffaa9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:04,004 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=900a43eaa6440b304c042081ba0e3a4b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:04,004 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696194124003"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194124003"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194124003"}]},"ts":"1696194124003"} 2023-10-01 21:02:04,004 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696194124004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194124004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194124004"}]},"ts":"1696194124004"} 2023-10-01 21:02:04,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 900a43eaa6440b304c042081ba0e3a4b, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:02:04,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 5fda66460f71f95d9f18efc7c15ffaa9, server=jenkins-hbase4.apache.org,42573,1696194083188}] 2023-10-01 21:02:04,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 21:02:04,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:02:04,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 900a43eaa6440b304c042081ba0e3a4b, disabling compactions & flushes 2023-10-01 21:02:04,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:02:04,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:02:04,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. after waiting 0 ms 2023-10-01 21:02:04,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:02:04,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:02:04,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5fda66460f71f95d9f18efc7c15ffaa9, disabling compactions & flushes 2023-10-01 21:02:04,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:02:04,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:02:04,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. after waiting 0 ms 2023-10-01 21:02:04,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:02:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:02:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:02:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:02:04,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b. 2023-10-01 21:02:04,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 900a43eaa6440b304c042081ba0e3a4b: 2023-10-01 21:02:04,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:02:04,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9. 2023-10-01 21:02:04,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5fda66460f71f95d9f18efc7c15ffaa9: 2023-10-01 21:02:04,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:02:04,172 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=900a43eaa6440b304c042081ba0e3a4b, regionState=CLOSED 2023-10-01 21:02:04,173 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696194124172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194124172"}]},"ts":"1696194124172"} 2023-10-01 21:02:04,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:02:04,173 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5fda66460f71f95d9f18efc7c15ffaa9, regionState=CLOSED 2023-10-01 21:02:04,173 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696194124173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194124173"}]},"ts":"1696194124173"} 2023-10-01 21:02:04,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-01 21:02:04,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 900a43eaa6440b304c042081ba0e3a4b, server=jenkins-hbase4.apache.org,35853,1696194083102 in 169 msec 2023-10-01 21:02:04,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-01 21:02:04,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 5fda66460f71f95d9f18efc7c15ffaa9, server=jenkins-hbase4.apache.org,42573,1696194083188 in 169 msec 2023-10-01 21:02:04,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=900a43eaa6440b304c042081ba0e3a4b, UNASSIGN in 176 msec 2023-10-01 21:02:04,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-01 21:02:04,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5fda66460f71f95d9f18efc7c15ffaa9, UNASSIGN in 177 msec 2023-10-01 21:02:04,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194124180"}]},"ts":"1696194124180"} 2023-10-01 21:02:04,181 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-01 21:02:04,182 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-01 21:02:04,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 191 msec 2023-10-01 21:02:04,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-01 21:02:04,298 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-01 21:02:04,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-01 21:02:04,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 21:02:04,302 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 21:02:04,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-01 21:02:04,303 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 21:02:04,304 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-01 21:02:04,308 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:02:04,308 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 21:02:04,308 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:02:04,308 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 21:02:04,308 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 21:02:04,308 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 21:02:04,309 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 21:02:04,309 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 21:02:04,309 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 21:02:04,309 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-01 21:02:04,310 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 21:02:04,310 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 21:02:04,310 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 21:02:04,310 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:04,310 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:04,310 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-01 21:02:04,310 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:04,310 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:04,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-01 21:02:04,312 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/recovered.edits] 2023-10-01 21:02:04,313 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/recovered.edits] 2023-10-01 21:02:04,316 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/cf/ce5709379ce34ef9a4d9a9b8e170136e to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/cf/ce5709379ce34ef9a4d9a9b8e170136e 2023-10-01 21:02:04,317 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/cf/3b09626baacd45fd82c2d08d7e705f67 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/cf/3b09626baacd45fd82c2d08d7e705f67 2023-10-01 21:02:04,320 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9/recovered.edits/9.seqid 2023-10-01 21:02:04,320 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b/recovered.edits/9.seqid 2023-10-01 21:02:04,320 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/5fda66460f71f95d9f18efc7c15ffaa9 2023-10-01 21:02:04,321 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemState/900a43eaa6440b304c042081ba0e3a4b 2023-10-01 21:02:04,321 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-01 21:02:04,321 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-01 21:02:04,322 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-01 21:02:04,327 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310010c8b9db1c8ac4abb884b7154318fcc1f to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310010c8b9db1c8ac4abb884b7154318fcc1f 2023-10-01 21:02:04,328 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310019e420fe0a20a4aeeab16ae468ccaa26a to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310019e420fe0a20a4aeeab16ae468ccaa26a 2023-10-01 21:02:04,329 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-01 21:02:04,331 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 21:02:04,334 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-01 21:02:04,336 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-01 21:02:04,339 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 21:02:04,339 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-01 21:02:04,339 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194124339"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:04,339 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194124339"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:04,341 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 21:02:04,341 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5fda66460f71f95d9f18efc7c15ffaa9, NAME => 'testtb-testExportFileSystemState,,1696194107871.5fda66460f71f95d9f18efc7c15ffaa9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 900a43eaa6440b304c042081ba0e3a4b, NAME => 'testtb-testExportFileSystemState,1,1696194107871.900a43eaa6440b304c042081ba0e3a4b.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 21:02:04,342 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-01 21:02:04,342 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696194124342"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:04,343 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-01 21:02:04,348 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-01 21:02:04,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 49 msec 2023-10-01 21:02:04,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-01 21:02:04,413 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-01 21:02:04,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-01 21:02:04,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-01 21:02:04,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-01 21:02:04,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-01 21:02:04,457 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 754) Potentially hanging thread: hconnection-0x67090907-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:45000 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_163890985_1 at /127.0.0.1:51104 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:39701 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:44802 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1964 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_163890985_1 at /127.0.0.1:44784 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:51118 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 206) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=1596 (was 1788) 2023-10-01 21:02:04,457 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 21:02:04,477 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=219, ProcessCount=170, AvailableMemoryMB=1595 2023-10-01 21:02:04,477 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 21:02:04,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 21:02:04,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-01 21:02:04,483 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 21:02:04,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-01 21:02:04,484 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 21:02:04,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 21:02:04,487 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:04,487 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:04,488 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4 empty. 2023-10-01 21:02:04,488 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b empty. 2023-10-01 21:02:04,488 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:04,488 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:04,488 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-01 21:02:04,501 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-01 21:02:04,502 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => a70c590dfb4a652bedf72532f28f5ea4, NAME => 'testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:02:04,505 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => f71657db443e7de25f1b0fe36cef8c5b, NAME => 'testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:02:04,516 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:04,517 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing f71657db443e7de25f1b0fe36cef8c5b, disabling compactions & flushes 2023-10-01 21:02:04,517 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:04,517 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:04,517 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. after waiting 0 ms 2023-10-01 21:02:04,517 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:04,517 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:04,517 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for f71657db443e7de25f1b0fe36cef8c5b: 2023-10-01 21:02:04,519 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:04,519 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing a70c590dfb4a652bedf72532f28f5ea4, disabling compactions & flushes 2023-10-01 21:02:04,519 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:04,520 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:04,520 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. after waiting 0 ms 2023-10-01 21:02:04,520 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:04,520 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:04,520 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for a70c590dfb4a652bedf72532f28f5ea4: 2023-10-01 21:02:04,522 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 21:02:04,523 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696194124523"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194124523"}]},"ts":"1696194124523"} 2023-10-01 21:02:04,523 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696194124523"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194124523"}]},"ts":"1696194124523"} 2023-10-01 21:02:04,525 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 21:02:04,526 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 21:02:04,526 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194124526"}]},"ts":"1696194124526"} 2023-10-01 21:02:04,528 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-01 21:02:04,532 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 21:02:04,533 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 21:02:04,533 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 21:02:04,533 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 21:02:04,534 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 21:02:04,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a70c590dfb4a652bedf72532f28f5ea4, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f71657db443e7de25f1b0fe36cef8c5b, ASSIGN}] 2023-10-01 21:02:04,537 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f71657db443e7de25f1b0fe36cef8c5b, ASSIGN 2023-10-01 21:02:04,537 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a70c590dfb4a652bedf72532f28f5ea4, ASSIGN 2023-10-01 21:02:04,538 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f71657db443e7de25f1b0fe36cef8c5b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35853,1696194083102; forceNewPlan=false, retain=false 2023-10-01 21:02:04,538 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a70c590dfb4a652bedf72532f28f5ea4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39185,1696194083151; forceNewPlan=false, retain=false 2023-10-01 21:02:04,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 21:02:04,688 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 21:02:04,690 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f71657db443e7de25f1b0fe36cef8c5b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:04,690 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a70c590dfb4a652bedf72532f28f5ea4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:04,691 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696194124690"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194124690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194124690"}]},"ts":"1696194124690"} 2023-10-01 21:02:04,691 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696194124690"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194124690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194124690"}]},"ts":"1696194124690"} 2023-10-01 21:02:04,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure f71657db443e7de25f1b0fe36cef8c5b, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:02:04,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure a70c590dfb4a652bedf72532f28f5ea4, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:02:04,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 21:02:04,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:04,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f71657db443e7de25f1b0fe36cef8c5b, NAME => 'testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 21:02:04,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:04,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a70c590dfb4a652bedf72532f28f5ea4, NAME => 'testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 21:02:04,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. service=AccessControlService 2023-10-01 21:02:04,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. service=AccessControlService 2023-10-01 21:02:04,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:02:04,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:02:04,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:04,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:04,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:04,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:04,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:04,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:04,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:04,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:04,850 INFO [StoreOpener-f71657db443e7de25f1b0fe36cef8c5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:04,850 INFO [StoreOpener-a70c590dfb4a652bedf72532f28f5ea4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:04,852 DEBUG [StoreOpener-f71657db443e7de25f1b0fe36cef8c5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/cf 2023-10-01 21:02:04,852 DEBUG [StoreOpener-a70c590dfb4a652bedf72532f28f5ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/cf 2023-10-01 21:02:04,852 DEBUG [StoreOpener-f71657db443e7de25f1b0fe36cef8c5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/cf 2023-10-01 21:02:04,852 DEBUG [StoreOpener-a70c590dfb4a652bedf72532f28f5ea4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/cf 2023-10-01 21:02:04,852 INFO [StoreOpener-f71657db443e7de25f1b0fe36cef8c5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f71657db443e7de25f1b0fe36cef8c5b columnFamilyName cf 2023-10-01 21:02:04,852 INFO [StoreOpener-a70c590dfb4a652bedf72532f28f5ea4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a70c590dfb4a652bedf72532f28f5ea4 columnFamilyName cf 2023-10-01 21:02:04,854 INFO [StoreOpener-f71657db443e7de25f1b0fe36cef8c5b-1] regionserver.HStore(310): Store=f71657db443e7de25f1b0fe36cef8c5b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:02:04,854 INFO [StoreOpener-a70c590dfb4a652bedf72532f28f5ea4-1] regionserver.HStore(310): Store=a70c590dfb4a652bedf72532f28f5ea4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:02:04,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:04,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:04,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:04,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:04,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:04,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:04,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:02:04,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:02:04,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f71657db443e7de25f1b0fe36cef8c5b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71299878, jitterRate=0.06245097517967224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:02:04,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a70c590dfb4a652bedf72532f28f5ea4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72220987, jitterRate=0.07617656886577606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:02:04,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f71657db443e7de25f1b0fe36cef8c5b: 2023-10-01 21:02:04,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a70c590dfb4a652bedf72532f28f5ea4: 2023-10-01 21:02:04,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b., pid=45, masterSystemTime=1696194124844 2023-10-01 21:02:04,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4., pid=46, masterSystemTime=1696194124845 2023-10-01 21:02:04,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:04,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:04,864 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a70c590dfb4a652bedf72532f28f5ea4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:04,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:04,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:04,864 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696194124864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194124864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194124864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194124864"}]},"ts":"1696194124864"} 2023-10-01 21:02:04,865 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f71657db443e7de25f1b0fe36cef8c5b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:04,865 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696194124865"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194124865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194124865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194124865"}]},"ts":"1696194124865"} 2023-10-01 21:02:04,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-10-01 21:02:04,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure a70c590dfb4a652bedf72532f28f5ea4, server=jenkins-hbase4.apache.org,39185,1696194083151 in 173 msec 2023-10-01 21:02:04,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-01 21:02:04,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure f71657db443e7de25f1b0fe36cef8c5b, server=jenkins-hbase4.apache.org,35853,1696194083102 in 175 msec 2023-10-01 21:02:04,870 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a70c590dfb4a652bedf72532f28f5ea4, ASSIGN in 334 msec 2023-10-01 21:02:04,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-10-01 21:02:04,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f71657db443e7de25f1b0fe36cef8c5b, ASSIGN in 336 msec 2023-10-01 21:02:04,873 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 21:02:04,873 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194124873"}]},"ts":"1696194124873"} 2023-10-01 21:02:04,875 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-01 21:02:04,877 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 21:02:04,877 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-01 21:02:04,879 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 21:02:04,881 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:04,881 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:04,881 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:04,881 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:04,882 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:04,882 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:04,882 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:04,882 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:04,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 403 msec 2023-10-01 21:02:05,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-01 21:02:05,087 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-01 21:02:05,090 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-01 21:02:05,090 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:05,092 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:02:05,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 21:02:05,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194125104 (current time:1696194125104). 2023-10-01 21:02:05,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:02:05,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x788e2183 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:05,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e0059cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:05,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:05,114 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:05,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x788e2183 to 127.0.0.1:53257 2023-10-01 21:02:05,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:05,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x17bc46c9 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:05,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eb7ff84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:05,124 DEBUG [hconnection-0x620513ae-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:05,126 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:05,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17bc46c9 to 127.0.0.1:53257 2023-10-01 21:02:05,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:05,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 21:02:05,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:02:05,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 21:02:05,136 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:02:05,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 21:02:05,138 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 21:02:05,139 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696194725139 2023-10-01 21:02:05,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 21:02:05,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-01 21:02:05,140 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:02:05,140 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:02:05,142 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 21:02:05,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 21:02:05,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-01 21:02:05,144 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 21:02:05,144 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696194725144 2023-10-01 21:02:05,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,157 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-01 21:02:05,157 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:05,158 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-01 21:02:05,158 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-01 21:02:05,159 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,159 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,161 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,161 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,161 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,161 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,162 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,162 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,162 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,162 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:02:05,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 21:02:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 21:02:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 21:02:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-01 21:02:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 21:02:05,163 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 21:02:05,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 21:02:05,163 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:05,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,164 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 21:02:05,164 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 21:02:05,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,164 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:05,164 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 21:02:05,165 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 21:02:05,165 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 21:02:05,164 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 21:02:05,165 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 21:02:05,165 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 21:02:05,165 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:05,168 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 21:02:05,168 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-01 21:02:05,168 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-01 21:02:05,170 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,170 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:05,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:05,170 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,170 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:05,170 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:05,170 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:05,171 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,171 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:05,171 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,172 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,172 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:05,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:05,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-01 21:02:05,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d07f9b7[Count = 1] remaining members to acquire global barrier 2023-10-01 21:02:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:05,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-01 21:02:05,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d07f9b7[Count = 0] remaining members to acquire global barrier 2023-10-01 21:02:05,175 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-01 21:02:05,175 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,176 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,177 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,177 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,177 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,177 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 21:02:05,177 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 21:02:05,177 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 21:02:05,177 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:02:05,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,177 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:05,177 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:05,177 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,177 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:02:05,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,177 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:05,177 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 21:02:05,177 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. started... 2023-10-01 21:02:05,178 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:05,178 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:05,178 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:05,178 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. started... 2023-10-01 21:02:05,178 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a70c590dfb4a652bedf72532f28f5ea4: 2023-10-01 21:02:05,179 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f71657db443e7de25f1b0fe36cef8c5b: 2023-10-01 21:02:05,179 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,179 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,179 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:05,179 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:05,179 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:02:05,179 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:02:05,184 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 21:02:05,184 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:05,184 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 21:02:05,193 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. completed. 2023-10-01 21:02:05,193 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:05,193 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:05,193 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:05,193 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,193 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 21:02:05,194 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:02:05,195 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 21:02:05,195 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:05,195 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,195 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 21:02:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39185,1696194083151': 2023-10-01 21:02:05,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-01 21:02:05,241 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:05,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 21:02:05,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:02:05,242 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 21:02:05,442 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:05,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 21:02:05,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:02:05,443 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-01 21:02:05,591 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. completed. 2023-10-01 21:02:05,591 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:05,591 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:05,591 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:05,591 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,591 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-01 21:02:05,592 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:02:05,593 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,593 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 21:02:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:05,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:05,593 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:05,594 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-01 21:02:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:05,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:02:05,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-01 21:02:05,598 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-01 21:02:05,598 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:02:05,598 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:02:05,598 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,598 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:02:05,599 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,599 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,599 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,599 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,599 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,599 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,600 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,600 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,600 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:05,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,601 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,602 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,603 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:05,603 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:02:05,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,607 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,607 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,609 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,609 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,609 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,609 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,609 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 21:02:05,609 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-01 21:02:05,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,638 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:05,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696194125139Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696194125619 (+480 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696194125619Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696194125619Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696194125623 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696194125631 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696194125637 (+6 ms) 2023-10-01 21:02:05,640 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 21:02:05,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 500 msec 2023-10-01 21:02:05,744 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:05,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 21:02:05,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:02:05,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39185] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:02:05,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35853] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:02:05,753 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-01 21:02:05,753 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:05,753 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:02:05,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 21:02:05,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194125763 (current time:1696194125763). 2023-10-01 21:02:05,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:02:05,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x642da2cf to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:05,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f832f42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:05,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:05,779 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:05,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x642da2cf to 127.0.0.1:53257 2023-10-01 21:02:05,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:05,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x56a0a245 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:05,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f125984, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:05,788 DEBUG [hconnection-0x794d941b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:05,789 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:05,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56a0a245 to 127.0.0.1:53257 2023-10-01 21:02:05,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:05,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-01 21:02:05,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:02:05,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 21:02:05,796 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:02:05,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 21:02:05,798 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 21:02:05,799 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696194725799 2023-10-01 21:02:05,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-01 21:02:05,799 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-01 21:02:05,800 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:02:05,800 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:02:05,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 21:02:05,802 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-01 21:02:05,803 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-01 21:02:05,804 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 21:02:05,804 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696194725804 2023-10-01 21:02:05,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-01 21:02:05,821 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-01 21:02:05,821 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:05,822 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-01 21:02:05,822 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-01 21:02:05,822 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,822 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,824 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,824 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,824 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,824 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,824 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,824 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,825 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,825 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:02:05,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 21:02:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 21:02:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,825 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 21:02:05,826 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 21:02:05,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-01 21:02:05,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,826 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-01 21:02:05,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 21:02:05,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 21:02:05,826 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 21:02:05,826 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:05,826 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 21:02:05,826 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:05,830 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 21:02:05,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-01 21:02:05,830 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 21:02:05,830 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-01 21:02:05,830 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:05,830 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 21:02:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 21:02:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-01 21:02:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-01 21:02:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 21:02:05,830 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 21:02:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-01 21:02:05,833 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,833 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,833 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,833 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:05,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:05,833 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,834 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,834 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,834 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:05,834 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:05,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:05,834 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,834 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:05,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:05,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 21:02:05,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:05,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-01 21:02:05,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fec3a58[Count = 1] remaining members to acquire global barrier 2023-10-01 21:02:05,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:05,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 21:02:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:05,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-01 21:02:05,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fec3a58[Count = 0] remaining members to acquire global barrier 2023-10-01 21:02:05,838 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-01 21:02:05,839 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,841 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,841 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,841 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,841 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,841 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 21:02:05,841 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 21:02:05,841 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 21:02:05,841 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:02:05,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,841 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:05,842 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-01 21:02:05,842 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:05,842 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,842 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:05,842 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:05,842 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:05,842 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:02:05,842 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. started... 2023-10-01 21:02:05,842 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:05,842 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. started... 2023-10-01 21:02:05,842 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f71657db443e7de25f1b0fe36cef8c5b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-01 21:02:05,842 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a70c590dfb4a652bedf72532f28f5ea4 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-01 21:02:05,843 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 21:02:05,843 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:05,843 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 21:02:05,874 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100149a6627337be400eb10565ea9bab09b9 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100149a6627337be400eb10565ea9bab09b9 2023-10-01 21:02:05,877 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310017f558c9acb5848c78093ef958edf7058 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310017f558c9acb5848c78093ef958edf7058 2023-10-01 21:02:05,893 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/.tmp/cf/a6225b8057d64c5cb3ff1ae10b0c5eb9 2023-10-01 21:02:05,895 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/.tmp/cf/038343dd9cf44fffb5d39ae3e33ef8a5 2023-10-01 21:02:05,899 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/.tmp/cf/a6225b8057d64c5cb3ff1ae10b0c5eb9 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/cf/a6225b8057d64c5cb3ff1ae10b0c5eb9 2023-10-01 21:02:05,900 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/.tmp/cf/038343dd9cf44fffb5d39ae3e33ef8a5 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/cf/038343dd9cf44fffb5d39ae3e33ef8a5 2023-10-01 21:02:05,901 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:05,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 21:02:05,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:02:05,902 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 21:02:05,905 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/cf/a6225b8057d64c5cb3ff1ae10b0c5eb9, entries=47, sequenceid=6, filesize=12.7 K 2023-10-01 21:02:05,905 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/cf/038343dd9cf44fffb5d39ae3e33ef8a5, entries=3, sequenceid=6, filesize=5.4 K 2023-10-01 21:02:05,906 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for f71657db443e7de25f1b0fe36cef8c5b in 64ms, sequenceid=6, compaction requested=false 2023-10-01 21:02:05,906 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-01 21:02:05,906 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for a70c590dfb4a652bedf72532f28f5ea4 in 64ms, sequenceid=6, compaction requested=false 2023-10-01 21:02:05,906 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f71657db443e7de25f1b0fe36cef8c5b: 2023-10-01 21:02:05,908 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a70c590dfb4a652bedf72532f28f5ea4: 2023-10-01 21:02:05,908 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 21:02:05,908 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:05,908 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/cf/a6225b8057d64c5cb3ff1ae10b0c5eb9] hfiles 2023-10-01 21:02:05,908 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/cf/a6225b8057d64c5cb3ff1ae10b0c5eb9 for snapshot=snaptb0-testConsecutiveExports 2023-10-01 21:02:05,908 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 21:02:05,908 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:05,908 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/cf/038343dd9cf44fffb5d39ae3e33ef8a5] hfiles 2023-10-01 21:02:05,908 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/cf/038343dd9cf44fffb5d39ae3e33ef8a5 for snapshot=snaptb0-testConsecutiveExports 2023-10-01 21:02:05,919 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. completed. 2023-10-01 21:02:05,919 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:05,919 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:05,919 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:05,920 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,920 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. completed. 2023-10-01 21:02:05,920 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 21:02:05,920 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:05,920 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:02:05,920 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:05,920 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:05,920 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,920 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-01 21:02:05,920 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:02:05,921 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,921 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 21:02:05,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,922 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:05,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:05,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:05,922 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 21:02:05,923 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,923 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-01 21:02:05,923 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:05,923 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-01 21:02:05,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:05,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:05,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 21:02:05,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:05,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 21:02:05,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39185,1696194083151': 2023-10-01 21:02:05,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-01 21:02:05,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:05,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:05,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:05,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:05,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 21:02:05,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:05,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 21:02:05,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:02:05,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-01 21:02:05,930 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-01 21:02:05,931 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:02:05,931 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:02:05,931 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-01 21:02:05,931 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:02:05,933 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,933 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:05,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:05,933 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,933 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,933 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,934 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:05,934 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,934 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 21:02:05,934 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:05,935 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 21:02:05,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:05,938 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-01 21:02:05,938 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,939 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,944 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,944 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,944 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,944 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,944 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,944 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:05,944 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,944 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,944 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:05,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,945 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-01 21:02:05,945 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:05,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:05,945 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:05,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-01 21:02:05,945 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:05,947 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-01 21:02:05,947 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:05,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:02:05,947 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:05,947 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,947 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100149a6627337be400eb10565ea9bab09b9, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310017f558c9acb5848c78093ef958edf7058] mob files 2023-10-01 21:02:05,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100149a6627337be400eb10565ea9bab09b9 2023-10-01 21:02:05,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310017f558c9acb5848c78093ef958edf7058 2023-10-01 21:02:05,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-01 21:02:05,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,978 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-01 21:02:05,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,978 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 21:02:05,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696194125799Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696194125958 (+159 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696194125958Loading Region manifests for snaptb0-testConsecutiveExports at 1696194125958Writing data manifest for snaptb0-testConsecutiveExports at 1696194125962 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696194125970 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696194125978 (+8 ms) 2023-10-01 21:02:05,983 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-01 21:02:05,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 183 msec 2023-10-01 21:02:06,102 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:06,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-01 21:02:06,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:02:06,104 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103 2023-10-01 21:02:06,104 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103, srcFsUri=hdfs://localhost:33955, srcDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:02:06,125 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:02:06,125 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7fc636a2, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 21:02:06,126 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89, snapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-01 21:02:06,134 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 21:02:06,146 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:06,146 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:06,147 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:06,147 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:07,027 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-2679296573431099120.jar 2023-10-01 21:02:07,027 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:07,028 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:07,094 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-1423762508177193600.jar 2023-10-01 21:02:07,094 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:07,095 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:07,095 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:07,096 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:07,096 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:07,096 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:07,097 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 21:02:07,097 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 21:02:07,097 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 21:02:07,098 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 21:02:07,098 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 21:02:07,099 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 21:02:07,099 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 21:02:07,099 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 21:02:07,100 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 21:02:07,100 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 21:02:07,101 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:07,101 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:07,102 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:07,102 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:07,102 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:07,103 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:07,103 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:07,483 WARN [Listener at jenkins-hbase4.apache.org/42645] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 21:02:07,485 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-01 21:02:07,487 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-01 21:02:08,328 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:02:08,328 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:02:08,332 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0002_000001 (auth:SIMPLE) 2023-10-01 21:02:09,125 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0003_000001 (auth:SIMPLE) 2023-10-01 21:02:09,784 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 21:02:12,855 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0003_000001 (auth:SIMPLE) 2023-10-01 21:02:15,075 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0003_000001 (auth:SIMPLE) 2023-10-01 21:02:17,443 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0003_000001 (auth:SIMPLE) 2023-10-01 21:02:18,646 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 21:02:18,646 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 21:02:18,650 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-01 21:02:18,650 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 21:02:18,651 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 21:02:18,651 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 21:02:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 21:02:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 21:02:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1b0a281e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 21:02:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 21:02:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 21:02:18,655 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103, srcFsUri=hdfs://localhost:33955, srcDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:02:18,676 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:02:18,676 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@767a063b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 21:02:18,676 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89, snapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-01 21:02:18,688 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-01 21:02:18,700 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:18,701 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:18,701 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:18,702 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:19,584 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-4735289361729408634.jar 2023-10-01 21:02:19,584 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:19,585 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:19,651 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-1225783039084015174.jar 2023-10-01 21:02:19,652 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:19,652 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:19,653 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:19,653 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:19,653 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:19,654 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:19,654 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 21:02:19,654 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 21:02:19,655 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 21:02:19,655 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 21:02:19,656 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 21:02:19,656 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 21:02:19,656 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 21:02:19,657 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 21:02:19,657 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 21:02:19,658 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 21:02:19,658 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:19,658 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:19,659 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:19,659 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:19,659 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:19,660 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:19,660 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:20,011 WARN [Listener at jenkins-hbase4.apache.org/42645] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 21:02:20,013 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-01 21:02:20,015 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-01 21:02:23,612 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:02:23,612 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:02:23,615 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0003_000001 (auth:SIMPLE) 2023-10-01 21:02:24,342 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0004_000001 (auth:SIMPLE) 2023-10-01 21:02:28,051 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0004_000001 (auth:SIMPLE) 2023-10-01 21:02:30,260 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0004_000001 (auth:SIMPLE) 2023-10-01 21:02:32,503 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0004_000001 (auth:SIMPLE) 2023-10-01 21:02:34,248 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 21:02:34,249 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 21:02:34,252 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-01 21:02:34,252 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 21:02:34,252 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 21:02:34,252 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 21:02:34,255 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 21:02:34,255 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 21:02:34,255 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1b0a281e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-01 21:02:34,255 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-01 21:02:34,255 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/local-export-1696194126103/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-01 21:02:34,267 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-01 21:02:34,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-01 21:02:34,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-01 21:02:34,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 21:02:34,272 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194154272"}]},"ts":"1696194154272"} 2023-10-01 21:02:34,273 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-01 21:02:34,275 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-01 21:02:34,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a70c590dfb4a652bedf72532f28f5ea4, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f71657db443e7de25f1b0fe36cef8c5b, UNASSIGN}] 2023-10-01 21:02:34,277 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a70c590dfb4a652bedf72532f28f5ea4, UNASSIGN 2023-10-01 21:02:34,277 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f71657db443e7de25f1b0fe36cef8c5b, UNASSIGN 2023-10-01 21:02:34,278 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a70c590dfb4a652bedf72532f28f5ea4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:34,278 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f71657db443e7de25f1b0fe36cef8c5b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:34,278 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696194154278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194154278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194154278"}]},"ts":"1696194154278"} 2023-10-01 21:02:34,278 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696194154278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194154278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194154278"}]},"ts":"1696194154278"} 2023-10-01 21:02:34,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure a70c590dfb4a652bedf72532f28f5ea4, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:02:34,280 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure f71657db443e7de25f1b0fe36cef8c5b, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:02:34,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 21:02:34,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:34,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:34,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a70c590dfb4a652bedf72532f28f5ea4, disabling compactions & flushes 2023-10-01 21:02:34,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f71657db443e7de25f1b0fe36cef8c5b, disabling compactions & flushes 2023-10-01 21:02:34,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:34,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:34,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:34,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:34,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. after waiting 0 ms 2023-10-01 21:02:34,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. after waiting 0 ms 2023-10-01 21:02:34,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:34,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:34,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:02:34,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:02:34,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:02:34,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:02:34,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4. 2023-10-01 21:02:34,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b. 2023-10-01 21:02:34,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f71657db443e7de25f1b0fe36cef8c5b: 2023-10-01 21:02:34,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a70c590dfb4a652bedf72532f28f5ea4: 2023-10-01 21:02:34,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:34,449 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f71657db443e7de25f1b0fe36cef8c5b, regionState=CLOSED 2023-10-01 21:02:34,450 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696194154449"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194154449"}]},"ts":"1696194154449"} 2023-10-01 21:02:34,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:34,450 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a70c590dfb4a652bedf72532f28f5ea4, regionState=CLOSED 2023-10-01 21:02:34,450 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696194154450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194154450"}]},"ts":"1696194154450"} 2023-10-01 21:02:34,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-01 21:02:34,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure f71657db443e7de25f1b0fe36cef8c5b, server=jenkins-hbase4.apache.org,35853,1696194083102 in 171 msec 2023-10-01 21:02:34,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-01 21:02:34,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure a70c590dfb4a652bedf72532f28f5ea4, server=jenkins-hbase4.apache.org,39185,1696194083151 in 172 msec 2023-10-01 21:02:34,454 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f71657db443e7de25f1b0fe36cef8c5b, UNASSIGN in 177 msec 2023-10-01 21:02:34,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-01 21:02:34,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a70c590dfb4a652bedf72532f28f5ea4, UNASSIGN in 177 msec 2023-10-01 21:02:34,456 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194154456"}]},"ts":"1696194154456"} 2023-10-01 21:02:34,457 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-01 21:02:34,460 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-01 21:02:34,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 193 msec 2023-10-01 21:02:34,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-01 21:02:34,574 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-01 21:02:34,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-01 21:02:34,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 21:02:34,578 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 21:02:34,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-01 21:02:34,578 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 21:02:34,581 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-01 21:02:34,583 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 21:02:34,583 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 21:02:34,583 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 21:02:34,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 21:02:34,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 21:02:34,584 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:34,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-01 21:02:34,584 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:34,585 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 21:02:34,585 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 21:02:34,585 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:34,585 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:34,585 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 21:02:34,585 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:34,585 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-01 21:02:34,585 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:34,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-10-01 21:02:34,586 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 21:02:34,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-01 21:02:34,587 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/recovered.edits] 2023-10-01 21:02:34,587 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/recovered.edits] 2023-10-01 21:02:34,591 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/cf/038343dd9cf44fffb5d39ae3e33ef8a5 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/cf/038343dd9cf44fffb5d39ae3e33ef8a5 2023-10-01 21:02:34,591 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/cf/a6225b8057d64c5cb3ff1ae10b0c5eb9 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/cf/a6225b8057d64c5cb3ff1ae10b0c5eb9 2023-10-01 21:02:34,594 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4/recovered.edits/9.seqid 2023-10-01 21:02:34,594 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b/recovered.edits/9.seqid 2023-10-01 21:02:34,594 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/a70c590dfb4a652bedf72532f28f5ea4 2023-10-01 21:02:34,595 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testConsecutiveExports/f71657db443e7de25f1b0fe36cef8c5b 2023-10-01 21:02:34,595 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-01 21:02:34,595 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-01 21:02:34,596 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-01 21:02:34,600 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100149a6627337be400eb10565ea9bab09b9 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100149a6627337be400eb10565ea9bab09b9 2023-10-01 21:02:34,601 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310017f558c9acb5848c78093ef958edf7058 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310017f558c9acb5848c78093ef958edf7058 2023-10-01 21:02:34,602 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-01 21:02:34,604 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 21:02:34,607 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-01 21:02:34,609 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-01 21:02:34,610 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 21:02:34,610 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-01 21:02:34,610 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194154610"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:34,610 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194154610"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:34,612 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 21:02:34,612 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a70c590dfb4a652bedf72532f28f5ea4, NAME => 'testtb-testConsecutiveExports,,1696194124479.a70c590dfb4a652bedf72532f28f5ea4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f71657db443e7de25f1b0fe36cef8c5b, NAME => 'testtb-testConsecutiveExports,1,1696194124479.f71657db443e7de25f1b0fe36cef8c5b.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 21:02:34,612 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-01 21:02:34,612 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696194154612"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:34,613 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-01 21:02:34,619 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-01 21:02:34,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-10-01 21:02:34,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-01 21:02:34,687 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-01 21:02:34,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-01 21:02:34,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-01 21:02:34,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-01 21:02:34,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-01 21:02:34,722 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 765), OpenFileDescriptor=901 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=163 (was 219), ProcessCount=170 (was 170), AvailableMemoryMB=1343 (was 1595) 2023-10-01 21:02:34,723 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-10-01 21:02:34,741 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=163, ProcessCount=170, AvailableMemoryMB=1342 2023-10-01 21:02:34,741 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-10-01 21:02:34,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 21:02:34,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:34,746 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 21:02:34,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-01 21:02:34,747 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 21:02:34,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 21:02:34,750 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:34,750 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:34,751 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185 empty. 2023-10-01 21:02:34,751 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de empty. 2023-10-01 21:02:34,751 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:34,751 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:34,751 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-01 21:02:34,764 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-01 21:02:34,765 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 585bbbec2ab31babaeaeaf0545f0a185, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:02:34,765 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 22ea4fe837c4044f8a8a138a535de0de, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:02:34,781 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:34,781 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 585bbbec2ab31babaeaeaf0545f0a185, disabling compactions & flushes 2023-10-01 21:02:34,781 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:34,781 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:34,781 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. after waiting 0 ms 2023-10-01 21:02:34,781 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:34,781 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:34,781 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 585bbbec2ab31babaeaeaf0545f0a185: 2023-10-01 21:02:34,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:34,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 22ea4fe837c4044f8a8a138a535de0de, disabling compactions & flushes 2023-10-01 21:02:34,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:34,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:34,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. after waiting 0 ms 2023-10-01 21:02:34,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:34,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:34,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 22ea4fe837c4044f8a8a138a535de0de: 2023-10-01 21:02:34,787 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 21:02:34,788 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696194154788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194154788"}]},"ts":"1696194154788"} 2023-10-01 21:02:34,788 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696194154788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194154788"}]},"ts":"1696194154788"} 2023-10-01 21:02:34,797 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 21:02:34,798 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 21:02:34,798 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194154798"}]},"ts":"1696194154798"} 2023-10-01 21:02:34,800 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-01 21:02:34,803 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 21:02:34,804 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 21:02:34,804 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 21:02:34,804 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 21:02:34,804 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 21:02:34,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=585bbbec2ab31babaeaeaf0545f0a185, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=22ea4fe837c4044f8a8a138a535de0de, ASSIGN}] 2023-10-01 21:02:34,807 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=22ea4fe837c4044f8a8a138a535de0de, ASSIGN 2023-10-01 21:02:34,807 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=585bbbec2ab31babaeaeaf0545f0a185, ASSIGN 2023-10-01 21:02:34,807 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=22ea4fe837c4044f8a8a138a535de0de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39185,1696194083151; forceNewPlan=false, retain=false 2023-10-01 21:02:34,808 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=585bbbec2ab31babaeaeaf0545f0a185, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35853,1696194083102; forceNewPlan=false, retain=false 2023-10-01 21:02:34,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 21:02:34,958 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 21:02:34,960 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=22ea4fe837c4044f8a8a138a535de0de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:34,960 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=585bbbec2ab31babaeaeaf0545f0a185, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:34,961 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696194154960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194154960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194154960"}]},"ts":"1696194154960"} 2023-10-01 21:02:34,961 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696194154960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194154960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194154960"}]},"ts":"1696194154960"} 2023-10-01 21:02:34,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 22ea4fe837c4044f8a8a138a535de0de, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:02:34,963 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 585bbbec2ab31babaeaeaf0545f0a185, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:02:35,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 21:02:35,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:35,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:35,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 585bbbec2ab31babaeaeaf0545f0a185, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 21:02:35,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 22ea4fe837c4044f8a8a138a535de0de, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 21:02:35,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. service=AccessControlService 2023-10-01 21:02:35,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. service=AccessControlService 2023-10-01 21:02:35,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:02:35,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:02:35,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:35,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:35,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:35,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:35,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:35,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:35,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:35,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:35,119 INFO [StoreOpener-22ea4fe837c4044f8a8a138a535de0de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:35,119 INFO [StoreOpener-585bbbec2ab31babaeaeaf0545f0a185-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:35,121 DEBUG [StoreOpener-22ea4fe837c4044f8a8a138a535de0de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/cf 2023-10-01 21:02:35,121 DEBUG [StoreOpener-22ea4fe837c4044f8a8a138a535de0de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/cf 2023-10-01 21:02:35,121 DEBUG [StoreOpener-585bbbec2ab31babaeaeaf0545f0a185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/cf 2023-10-01 21:02:35,121 DEBUG [StoreOpener-585bbbec2ab31babaeaeaf0545f0a185-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/cf 2023-10-01 21:02:35,122 INFO [StoreOpener-22ea4fe837c4044f8a8a138a535de0de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22ea4fe837c4044f8a8a138a535de0de columnFamilyName cf 2023-10-01 21:02:35,122 INFO [StoreOpener-585bbbec2ab31babaeaeaf0545f0a185-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 585bbbec2ab31babaeaeaf0545f0a185 columnFamilyName cf 2023-10-01 21:02:35,123 INFO [StoreOpener-22ea4fe837c4044f8a8a138a535de0de-1] regionserver.HStore(310): Store=22ea4fe837c4044f8a8a138a535de0de/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:02:35,123 INFO [StoreOpener-585bbbec2ab31babaeaeaf0545f0a185-1] regionserver.HStore(310): Store=585bbbec2ab31babaeaeaf0545f0a185/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:02:35,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:35,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:35,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:35,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:35,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:35,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:35,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:02:35,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:02:35,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 585bbbec2ab31babaeaeaf0545f0a185; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69936153, jitterRate=0.042129889130592346}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:02:35,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 585bbbec2ab31babaeaeaf0545f0a185: 2023-10-01 21:02:35,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 22ea4fe837c4044f8a8a138a535de0de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67977163, jitterRate=0.012938663363456726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:02:35,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 22ea4fe837c4044f8a8a138a535de0de: 2023-10-01 21:02:35,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185., pid=61, masterSystemTime=1696194155114 2023-10-01 21:02:35,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de., pid=60, masterSystemTime=1696194155114 2023-10-01 21:02:35,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:35,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:35,133 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=585bbbec2ab31babaeaeaf0545f0a185, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:35,133 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696194155133"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194155133"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194155133"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194155133"}]},"ts":"1696194155133"} 2023-10-01 21:02:35,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:35,134 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=22ea4fe837c4044f8a8a138a535de0de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,134 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696194155133"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194155133"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194155133"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194155133"}]},"ts":"1696194155133"} 2023-10-01 21:02:35,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-10-01 21:02:35,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 585bbbec2ab31babaeaeaf0545f0a185, server=jenkins-hbase4.apache.org,35853,1696194083102 in 172 msec 2023-10-01 21:02:35,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-01 21:02:35,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 22ea4fe837c4044f8a8a138a535de0de, server=jenkins-hbase4.apache.org,39185,1696194083151 in 174 msec 2023-10-01 21:02:35,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=585bbbec2ab31babaeaeaf0545f0a185, ASSIGN in 333 msec 2023-10-01 21:02:35,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-01 21:02:35,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=22ea4fe837c4044f8a8a138a535de0de, ASSIGN in 334 msec 2023-10-01 21:02:35,140 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 21:02:35,140 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194155140"}]},"ts":"1696194155140"} 2023-10-01 21:02:35,142 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-01 21:02:35,144 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 21:02:35,144 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-01 21:02:35,146 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 21:02:35,149 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:35,149 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:35,149 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:35,149 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:35,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:35,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:35,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:35,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:35,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 407 msec 2023-10-01 21:02:35,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-01 21:02:35,351 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-01 21:02:35,353 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,353 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:35,356 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:02:35,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 21:02:35,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194155368 (current time:1696194155368). 2023-10-01 21:02:35,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:02:35,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x0df97c2e to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:35,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18edb462, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:35,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:35,380 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:35,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0df97c2e to 127.0.0.1:53257 2023-10-01 21:02:35,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:35,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x20035b07 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:35,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@665d4b25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:35,388 DEBUG [hconnection-0x13e6ad28-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:35,390 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:35,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20035b07 to 127.0.0.1:53257 2023-10-01 21:02:35,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:35,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 21:02:35,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:02:35,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 21:02:35,399 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:02:35,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 21:02:35,401 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 21:02:35,402 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696194755402 2023-10-01 21:02:35,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 21:02:35,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,403 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:02:35,403 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:02:35,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 21:02:35,404 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 21:02:35,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-01 21:02:35,406 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 21:02:35,407 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696194755407 2023-10-01 21:02:35,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,416 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-01 21:02:35,416 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:35,417 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-01 21:02:35,417 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-01 21:02:35,418 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,418 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,419 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,419 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,419 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,419 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,419 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,419 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,420 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,420 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:02:35,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 21:02:35,421 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,421 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:35,421 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 21:02:35,422 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 21:02:35,422 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 21:02:35,422 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 21:02:35,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,422 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:35,422 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 21:02:35,423 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 21:02:35,423 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 21:02:35,423 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:35,423 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 21:02:35,424 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 21:02:35,424 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 21:02:35,424 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 21:02:35,425 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,425 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:35,430 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,430 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,430 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,430 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,431 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:35,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:35,431 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,431 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:35,431 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,431 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:35,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:35,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:35,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 21:02:35,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@436f5097[Count = 1] remaining members to acquire global barrier 2023-10-01 21:02:35,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:35,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:35,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:35,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:35,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:35,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 21:02:35,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@436f5097[Count = 0] remaining members to acquire global barrier 2023-10-01 21:02:35,434 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-01 21:02:35,434 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,435 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,435 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,435 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,436 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,436 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 21:02:35,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,436 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:35,436 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 21:02:35,436 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,436 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:02:35,436 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:35,436 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:35,436 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:35,436 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:35,436 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 21:02:35,436 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. started... 2023-10-01 21:02:35,436 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 21:02:35,436 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:35,436 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:02:35,436 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. started... 2023-10-01 21:02:35,437 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 22ea4fe837c4044f8a8a138a535de0de: 2023-10-01 21:02:35,437 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 585bbbec2ab31babaeaeaf0545f0a185: 2023-10-01 21:02:35,438 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,438 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,438 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:35,438 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:35,438 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:02:35,438 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:02:35,447 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 21:02:35,447 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:35,447 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 21:02:35,451 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. completed. 2023-10-01 21:02:35,451 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:35,451 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. completed. 2023-10-01 21:02:35,451 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:35,452 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:35,452 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,452 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:35,452 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 21:02:35,452 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:35,452 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:35,452 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,452 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:02:35,452 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 21:02:35,452 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:02:35,453 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 21:02:35,453 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:35,453 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,453 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 21:02:35,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:35,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:35,454 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,454 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 21:02:35,454 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:35,454 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 21:02:35,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:35,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39185,1696194083151': 2023-10-01 21:02:35,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-01 21:02:35,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:35,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:35,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:02:35,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-01 21:02:35,461 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-01 21:02:35,461 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:02:35,461 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:02:35,461 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,461 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:02:35,462 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,463 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,462 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,462 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,463 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:35,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:35,463 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,463 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,463 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:35,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,463 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,464 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:35,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,466 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:35,466 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,467 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,471 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,471 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,471 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,471 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,471 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:35,471 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,471 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,472 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,471 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,472 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,471 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:02:35,473 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,472 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,473 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,473 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,473 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,473 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 21:02:35,473 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,473 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,503 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:35,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 21:02:35,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:02:35,504 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 21:02:35,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,507 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-01 21:02:35,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,507 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696194155402Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696194155484 (+82 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696194155484Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696194155484Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696194155490 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696194155501 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696194155507 (+6 ms) 2023-10-01 21:02:35,510 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 21:02:35,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 107 msec 2023-10-01 21:02:35,705 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:35,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 21:02:35,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:02:35,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35853] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:02:35,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39185] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:02:35,712 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,712 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:35,712 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:02:35,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 21:02:35,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194155722 (current time:1696194155722). 2023-10-01 21:02:35,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:02:35,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x01e6329e to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:35,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7331bc27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:35,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:35,732 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:35,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01e6329e to 127.0.0.1:53257 2023-10-01 21:02:35,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:35,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x51c6a81e to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:35,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6104127a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:35,739 DEBUG [hconnection-0x1f2a5af9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:35,741 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:35,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51c6a81e to 127.0.0.1:53257 2023-10-01 21:02:35,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:35,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-01 21:02:35,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:02:35,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 21:02:35,749 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:02:35,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 21:02:35,751 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 21:02:35,751 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696194755751 2023-10-01 21:02:35,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-01 21:02:35,751 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,752 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:02:35,753 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:02:35,754 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-01 21:02:35,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 21:02:35,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-01 21:02:35,755 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 21:02:35,756 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696194755756 2023-10-01 21:02:35,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,764 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-01 21:02:35,764 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:35,765 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-01 21:02:35,765 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-01 21:02:35,765 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,765 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,766 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,766 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,766 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,766 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,767 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,767 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,767 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,767 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:02:35,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-01 21:02:35,768 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-01 21:02:35,768 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:35,769 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 21:02:35,769 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:35,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,770 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 21:02:35,770 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-01 21:02:35,770 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:35,770 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 21:02:35,770 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 21:02:35,770 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-01 21:02:35,771 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 21:02:35,770 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-01 21:02:35,771 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 21:02:35,771 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 21:02:35,771 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-01 21:02:35,772 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,772 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,772 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:35,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:35,773 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,773 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:35,773 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:35,773 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,773 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,773 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:35,773 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,773 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:35,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:35,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 21:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42339e47[Count = 1] remaining members to acquire global barrier 2023-10-01 21:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:35,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-01 21:02:35,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42339e47[Count = 0] remaining members to acquire global barrier 2023-10-01 21:02:35,777 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-01 21:02:35,777 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,779 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,779 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,779 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 21:02:35,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,779 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:35,779 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:35,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,779 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. started... 2023-10-01 21:02:35,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,779 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,779 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:02:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:35,779 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 22ea4fe837c4044f8a8a138a535de0de 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-01 21:02:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 21:02:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-01 21:02:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 21:02:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:02:35,780 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:35,780 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:35,780 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:35,780 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. started... 2023-10-01 21:02:35,780 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 585bbbec2ab31babaeaeaf0545f0a185 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-01 21:02:35,781 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 21:02:35,781 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:35,781 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 21:02:35,795 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001ad5db2c79cfc4e258bdfaf89e3b9f50f to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231001ad5db2c79cfc4e258bdfaf89e3b9f50f 2023-10-01 21:02:35,796 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001569894843a7d4428bd6ec0e5a6d843af to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231001569894843a7d4428bd6ec0e5a6d843af 2023-10-01 21:02:35,802 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/.tmp/cf/c7588de785784a528753fda84daed4da 2023-10-01 21:02:35,803 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/.tmp/cf/75ae4e4aef984b46ad419fd701ef8537 2023-10-01 21:02:35,807 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/.tmp/cf/c7588de785784a528753fda84daed4da as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/cf/c7588de785784a528753fda84daed4da 2023-10-01 21:02:35,808 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/.tmp/cf/75ae4e4aef984b46ad419fd701ef8537 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/cf/75ae4e4aef984b46ad419fd701ef8537 2023-10-01 21:02:35,812 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/cf/c7588de785784a528753fda84daed4da, entries=4, sequenceid=6, filesize=5.6 K 2023-10-01 21:02:35,812 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/cf/75ae4e4aef984b46ad419fd701ef8537, entries=46, sequenceid=6, filesize=13.3 K 2023-10-01 21:02:35,813 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 585bbbec2ab31babaeaeaf0545f0a185 in 33ms, sequenceid=6, compaction requested=false 2023-10-01 21:02:35,813 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-01 21:02:35,814 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 585bbbec2ab31babaeaeaf0545f0a185: 2023-10-01 21:02:35,814 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,814 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:35,814 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/cf/c7588de785784a528753fda84daed4da] hfiles 2023-10-01 21:02:35,814 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/cf/c7588de785784a528753fda84daed4da for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,815 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 22ea4fe837c4044f8a8a138a535de0de in 35ms, sequenceid=6, compaction requested=false 2023-10-01 21:02:35,816 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 22ea4fe837c4044f8a8a138a535de0de: 2023-10-01 21:02:35,816 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,816 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:35,816 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/cf/75ae4e4aef984b46ad419fd701ef8537] hfiles 2023-10-01 21:02:35,816 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/cf/75ae4e4aef984b46ad419fd701ef8537 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,823 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. completed. 2023-10-01 21:02:35,823 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:35,823 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:35,823 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:35,823 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,823 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. completed. 2023-10-01 21:02:35,823 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 21:02:35,823 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:35,823 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:02:35,823 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:35,823 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:35,824 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,824 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-01 21:02:35,824 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:02:35,825 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,825 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 21:02:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:35,825 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:35,825 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,825 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 21:02:35,825 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-01 21:02:35,827 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:35,827 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-01 21:02:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:35,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:02:35,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-01 21:02:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:35,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39185,1696194083151': 2023-10-01 21:02:35,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-01 21:02:35,833 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-01 21:02:35,833 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:02:35,833 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:02:35,833 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,833 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:02:35,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,840 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:35,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,840 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,840 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:35,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,840 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,841 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,843 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:35,843 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,843 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:35,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:35,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,846 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:35,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:02:35,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:35,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,846 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:35,848 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:35,848 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,848 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:35,848 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:35,848 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,848 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231001569894843a7d4428bd6ec0e5a6d843af, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231001ad5db2c79cfc4e258bdfaf89e3b9f50f] mob files 2023-10-01 21:02:35,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231001569894843a7d4428bd6ec0e5a6d843af 2023-10-01 21:02:35,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231001ad5db2c79cfc4e258bdfaf89e3b9f50f 2023-10-01 21:02:35,853 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:35,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 21:02:35,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:02:35,854 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 21:02:35,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-01 21:02:35,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,873 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:35,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696194155752Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696194155855 (+103 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696194155855Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696194155855Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696194155858 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696194155864 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696194155873 (+9 ms) 2023-10-01 21:02:35,876 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-01 21:02:35,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 124 msec 2023-10-01 21:02:36,054 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:36,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-01 21:02:36,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:02:36,084 DEBUG [Listener at jenkins-hbase4.apache.org/42645] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 21:02:36,087 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 21:02:36,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35853] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 21:02:36,089 DEBUG [Listener at jenkins-hbase4.apache.org/42645] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 21:02:36,093 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 21:02:36,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39185] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 21:02:36,093 DEBUG [Listener at jenkins-hbase4.apache.org/42645] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-01 21:02:36,096 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-01 21:02:36,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42573] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-01 21:02:36,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-01 21:02:36,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:36,101 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 21:02:36,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-01 21:02:36,102 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 21:02:36,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 21:02:36,104 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,104 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,104 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25 empty. 2023-10-01 21:02:36,104 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768 empty. 2023-10-01 21:02:36,105 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,105 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,105 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-01 21:02:36,115 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-01 21:02:36,116 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => cf1fa8792ef45f298179f421d22c0a25, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:02:36,117 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7a17f1906c8397e88d554c6d5c5e5768, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:02:36,123 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:36,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing cf1fa8792ef45f298179f421d22c0a25, disabling compactions & flushes 2023-10-01 21:02:36,124 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. after waiting 0 ms 2023-10-01 21:02:36,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,124 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for cf1fa8792ef45f298179f421d22c0a25: 2023-10-01 21:02:36,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:36,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 7a17f1906c8397e88d554c6d5c5e5768, disabling compactions & flushes 2023-10-01 21:02:36,125 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. after waiting 0 ms 2023-10-01 21:02:36,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,125 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 7a17f1906c8397e88d554c6d5c5e5768: 2023-10-01 21:02:36,128 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 21:02:36,129 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696194156129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194156129"}]},"ts":"1696194156129"} 2023-10-01 21:02:36,129 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696194156129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194156129"}]},"ts":"1696194156129"} 2023-10-01 21:02:36,131 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 21:02:36,132 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 21:02:36,132 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194156132"}]},"ts":"1696194156132"} 2023-10-01 21:02:36,134 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-01 21:02:36,136 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 21:02:36,137 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 21:02:36,138 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 21:02:36,138 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 21:02:36,138 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 21:02:36,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cf1fa8792ef45f298179f421d22c0a25, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a17f1906c8397e88d554c6d5c5e5768, ASSIGN}] 2023-10-01 21:02:36,140 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cf1fa8792ef45f298179f421d22c0a25, ASSIGN 2023-10-01 21:02:36,140 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a17f1906c8397e88d554c6d5c5e5768, ASSIGN 2023-10-01 21:02:36,141 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cf1fa8792ef45f298179f421d22c0a25, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35853,1696194083102; forceNewPlan=false, retain=false 2023-10-01 21:02:36,141 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a17f1906c8397e88d554c6d5c5e5768, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39185,1696194083151; forceNewPlan=false, retain=false 2023-10-01 21:02:36,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 21:02:36,291 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 21:02:36,294 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=7a17f1906c8397e88d554c6d5c5e5768, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:36,294 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=cf1fa8792ef45f298179f421d22c0a25, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:36,294 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696194156293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194156293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194156293"}]},"ts":"1696194156293"} 2023-10-01 21:02:36,294 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696194156293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194156293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194156293"}]},"ts":"1696194156293"} 2023-10-01 21:02:36,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 7a17f1906c8397e88d554c6d5c5e5768, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:02:36,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure cf1fa8792ef45f298179f421d22c0a25, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:02:36,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 21:02:36,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a17f1906c8397e88d554c6d5c5e5768, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768.', STARTKEY => '2', ENDKEY => ''} 2023-10-01 21:02:36,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf1fa8792ef45f298179f421d22c0a25, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25.', STARTKEY => '', ENDKEY => '2'} 2023-10-01 21:02:36,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. service=AccessControlService 2023-10-01 21:02:36,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. service=AccessControlService 2023-10-01 21:02:36,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:02:36,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:02:36,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:36,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:36,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,453 INFO [StoreOpener-cf1fa8792ef45f298179f421d22c0a25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,453 INFO [StoreOpener-7a17f1906c8397e88d554c6d5c5e5768-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,454 DEBUG [StoreOpener-cf1fa8792ef45f298179f421d22c0a25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/cf 2023-10-01 21:02:36,454 DEBUG [StoreOpener-cf1fa8792ef45f298179f421d22c0a25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/cf 2023-10-01 21:02:36,454 DEBUG [StoreOpener-7a17f1906c8397e88d554c6d5c5e5768-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/cf 2023-10-01 21:02:36,455 DEBUG [StoreOpener-7a17f1906c8397e88d554c6d5c5e5768-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/cf 2023-10-01 21:02:36,455 INFO [StoreOpener-cf1fa8792ef45f298179f421d22c0a25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf1fa8792ef45f298179f421d22c0a25 columnFamilyName cf 2023-10-01 21:02:36,455 INFO [StoreOpener-7a17f1906c8397e88d554c6d5c5e5768-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a17f1906c8397e88d554c6d5c5e5768 columnFamilyName cf 2023-10-01 21:02:36,455 INFO [StoreOpener-cf1fa8792ef45f298179f421d22c0a25-1] regionserver.HStore(310): Store=cf1fa8792ef45f298179f421d22c0a25/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:02:36,455 INFO [StoreOpener-7a17f1906c8397e88d554c6d5c5e5768-1] regionserver.HStore(310): Store=7a17f1906c8397e88d554c6d5c5e5768/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:02:36,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:02:36,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:02:36,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cf1fa8792ef45f298179f421d22c0a25; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73755197, jitterRate=0.09903807938098907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:02:36,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7a17f1906c8397e88d554c6d5c5e5768; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69230400, jitterRate=0.03161334991455078}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:02:36,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cf1fa8792ef45f298179f421d22c0a25: 2023-10-01 21:02:36,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7a17f1906c8397e88d554c6d5c5e5768: 2023-10-01 21:02:36,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25., pid=70, masterSystemTime=1696194156447 2023-10-01 21:02:36,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768., pid=69, masterSystemTime=1696194156447 2023-10-01 21:02:36,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,465 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=7a17f1906c8397e88d554c6d5c5e5768, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:36,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,465 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696194156465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194156465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194156465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194156465"}]},"ts":"1696194156465"} 2023-10-01 21:02:36,465 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=cf1fa8792ef45f298179f421d22c0a25, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:36,465 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696194156465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194156465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194156465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194156465"}]},"ts":"1696194156465"} 2023-10-01 21:02:36,468 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-01 21:02:36,468 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 7a17f1906c8397e88d554c6d5c5e5768, server=jenkins-hbase4.apache.org,39185,1696194083151 in 171 msec 2023-10-01 21:02:36,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-01 21:02:36,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure cf1fa8792ef45f298179f421d22c0a25, server=jenkins-hbase4.apache.org,35853,1696194083102 in 171 msec 2023-10-01 21:02:36,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a17f1906c8397e88d554c6d5c5e5768, ASSIGN in 330 msec 2023-10-01 21:02:36,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-01 21:02:36,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cf1fa8792ef45f298179f421d22c0a25, ASSIGN in 331 msec 2023-10-01 21:02:36,471 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 21:02:36,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194156471"}]},"ts":"1696194156471"} 2023-10-01 21:02:36,472 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-01 21:02:36,475 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 21:02:36,476 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-01 21:02:36,477 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-01 21:02:36,478 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:36,478 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:36,478 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:36,478 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:36,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:36,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:36,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:36,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:36,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:36,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:36,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:36,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:36,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 381 msec 2023-10-01 21:02:36,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-01 21:02:36,705 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-01 21:02:36,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions cf1fa8792ef45f298179f421d22c0a25, 7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[cf1fa8792ef45f298179f421d22c0a25, 7a17f1906c8397e88d554c6d5c5e5768], force=true 2023-10-01 21:02:36,736 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[cf1fa8792ef45f298179f421d22c0a25, 7a17f1906c8397e88d554c6d5c5e5768], force=true 2023-10-01 21:02:36,736 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[cf1fa8792ef45f298179f421d22c0a25, 7a17f1906c8397e88d554c6d5c5e5768], force=true 2023-10-01 21:02:36,736 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[cf1fa8792ef45f298179f421d22c0a25, 7a17f1906c8397e88d554c6d5c5e5768], force=true 2023-10-01 21:02:36,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 21:02:36,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cf1fa8792ef45f298179f421d22c0a25, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a17f1906c8397e88d554c6d5c5e5768, UNASSIGN}] 2023-10-01 21:02:36,758 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cf1fa8792ef45f298179f421d22c0a25, UNASSIGN 2023-10-01 21:02:36,758 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a17f1906c8397e88d554c6d5c5e5768, UNASSIGN 2023-10-01 21:02:36,759 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=7a17f1906c8397e88d554c6d5c5e5768, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:36,759 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=cf1fa8792ef45f298179f421d22c0a25, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:36,759 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696194156759"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194156759"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194156759"}]},"ts":"1696194156759"} 2023-10-01 21:02:36,759 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696194156759"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194156759"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194156759"}]},"ts":"1696194156759"} 2023-10-01 21:02:36,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 7a17f1906c8397e88d554c6d5c5e5768, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:02:36,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure cf1fa8792ef45f298179f421d22c0a25, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:02:36,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 21:02:36,851 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 21:02:36,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7a17f1906c8397e88d554c6d5c5e5768, disabling compactions & flushes 2023-10-01 21:02:36,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. after waiting 0 ms 2023-10-01 21:02:36,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7a17f1906c8397e88d554c6d5c5e5768 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-01 21:02:36,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cf1fa8792ef45f298179f421d22c0a25, disabling compactions & flushes 2023-10-01 21:02:36,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. after waiting 0 ms 2023-10-01 21:02:36,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cf1fa8792ef45f298179f421d22c0a25 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-01 21:02:36,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/.tmp/cf/06aa1b57d7ab4b7ea66f3143563278e7 2023-10-01 21:02:36,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/.tmp/cf/91743ad58a5c4a969c13506106704c09 2023-10-01 21:02:36,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/.tmp/cf/06aa1b57d7ab4b7ea66f3143563278e7 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/cf/06aa1b57d7ab4b7ea66f3143563278e7 2023-10-01 21:02:36,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/.tmp/cf/91743ad58a5c4a969c13506106704c09 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/cf/91743ad58a5c4a969c13506106704c09 2023-10-01 21:02:36,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/cf/06aa1b57d7ab4b7ea66f3143563278e7, entries=1, sequenceid=5, filesize=4.7 K 2023-10-01 21:02:36,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/cf/91743ad58a5c4a969c13506106704c09, entries=1, sequenceid=5, filesize=4.7 K 2023-10-01 21:02:36,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 7a17f1906c8397e88d554c6d5c5e5768 in 23ms, sequenceid=5, compaction requested=false 2023-10-01 21:02:36,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for cf1fa8792ef45f298179f421d22c0a25 in 24ms, sequenceid=5, compaction requested=false 2023-10-01 21:02:36,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-01 21:02:36,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-01 21:02:36,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:02:36,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768. 2023-10-01 21:02:36,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:02:36,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7a17f1906c8397e88d554c6d5c5e5768: 2023-10-01 21:02:36,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25. 2023-10-01 21:02:36,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cf1fa8792ef45f298179f421d22c0a25: 2023-10-01 21:02:36,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:36,950 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=7a17f1906c8397e88d554c6d5c5e5768, regionState=CLOSED 2023-10-01 21:02:36,950 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696194156950"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194156950"}]},"ts":"1696194156950"} 2023-10-01 21:02:36,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:36,951 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=cf1fa8792ef45f298179f421d22c0a25, regionState=CLOSED 2023-10-01 21:02:36,951 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696194156951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194156951"}]},"ts":"1696194156951"} 2023-10-01 21:02:36,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-01 21:02:36,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 7a17f1906c8397e88d554c6d5c5e5768, server=jenkins-hbase4.apache.org,39185,1696194083151 in 190 msec 2023-10-01 21:02:36,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-01 21:02:36,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure cf1fa8792ef45f298179f421d22c0a25, server=jenkins-hbase4.apache.org,35853,1696194083102 in 190 msec 2023-10-01 21:02:36,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a17f1906c8397e88d554c6d5c5e5768, UNASSIGN in 197 msec 2023-10-01 21:02:36,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-01 21:02:36,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cf1fa8792ef45f298179f421d22c0a25, UNASSIGN in 200 msec 2023-10-01 21:02:36,998 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-01 21:02:37,000 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156098.cf1fa8792ef45f298179f421d22c0a25.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:37,000 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696194156098.7a17f1906c8397e88d554c6d5c5e5768.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:37,000 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:37,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 21:02:37,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4095c5f64f061d5b4d6342f39218f502, ASSIGN}] 2023-10-01 21:02:37,049 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4095c5f64f061d5b4d6342f39218f502, ASSIGN 2023-10-01 21:02:37,050 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4095c5f64f061d5b4d6342f39218f502, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,35853,1696194083102; forceNewPlan=false, retain=false 2023-10-01 21:02:37,200 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-01 21:02:37,202 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4095c5f64f061d5b4d6342f39218f502, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,202 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696194157202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194157202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194157202"}]},"ts":"1696194157202"} 2023-10-01 21:02:37,204 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4095c5f64f061d5b4d6342f39218f502, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:02:37,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 21:02:37,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. 2023-10-01 21:02:37,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4095c5f64f061d5b4d6342f39218f502, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.', STARTKEY => '', ENDKEY => ''} 2023-10-01 21:02:37,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. service=AccessControlService 2023-10-01 21:02:37,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:02:37,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:37,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:37,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:37,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:37,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/.regioninfo 2023-10-01 21:02:37,368 INFO [StoreOpener-4095c5f64f061d5b4d6342f39218f502-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:37,369 DEBUG [StoreOpener-4095c5f64f061d5b4d6342f39218f502-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf 2023-10-01 21:02:37,369 DEBUG [StoreOpener-4095c5f64f061d5b4d6342f39218f502-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf 2023-10-01 21:02:37,370 INFO [StoreOpener-4095c5f64f061d5b4d6342f39218f502-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4095c5f64f061d5b4d6342f39218f502 columnFamilyName cf 2023-10-01 21:02:37,396 DEBUG [StoreOpener-4095c5f64f061d5b4d6342f39218f502-1] regionserver.HStore(539): loaded hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf/06aa1b57d7ab4b7ea66f3143563278e7.7a17f1906c8397e88d554c6d5c5e5768->hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/cf/06aa1b57d7ab4b7ea66f3143563278e7-top 2023-10-01 21:02:37,401 DEBUG [StoreOpener-4095c5f64f061d5b4d6342f39218f502-1] regionserver.HStore(539): loaded hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf/91743ad58a5c4a969c13506106704c09.cf1fa8792ef45f298179f421d22c0a25->hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/cf/91743ad58a5c4a969c13506106704c09-top 2023-10-01 21:02:37,402 INFO [StoreOpener-4095c5f64f061d5b4d6342f39218f502-1] regionserver.HStore(310): Store=4095c5f64f061d5b4d6342f39218f502/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:02:37,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:37,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:37,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:37,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4095c5f64f061d5b4d6342f39218f502; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64315772, jitterRate=-0.04162031412124634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:02:37,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4095c5f64f061d5b4d6342f39218f502: 2023-10-01 21:02:37,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502., pid=77, masterSystemTime=1696194157355 2023-10-01 21:02:37,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.,because compaction is disabled. 2023-10-01 21:02:37,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. 2023-10-01 21:02:37,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. 2023-10-01 21:02:37,410 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4095c5f64f061d5b4d6342f39218f502, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,410 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696194157410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194157410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194157410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194157410"}]},"ts":"1696194157410"} 2023-10-01 21:02:37,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-01 21:02:37,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4095c5f64f061d5b4d6342f39218f502, server=jenkins-hbase4.apache.org,35853,1696194083102 in 208 msec 2023-10-01 21:02:37,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-01 21:02:37,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4095c5f64f061d5b4d6342f39218f502, ASSIGN in 364 msec 2023-10-01 21:02:37,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[cf1fa8792ef45f298179f421d22c0a25, 7a17f1906c8397e88d554c6d5c5e5768], force=true in 686 msec 2023-10-01 21:02:37,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-01 21:02:37,843 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-01 21:02:37,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 21:02:37,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194157844 (current time:1696194157844). 2023-10-01 21:02:37,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:02:37,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x41222da7 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:37,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d0d93a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:37,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:37,853 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:37,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41222da7 to 127.0.0.1:53257 2023-10-01 21:02:37,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:37,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x042405c0 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:37,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54bb4ff6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:37,861 DEBUG [hconnection-0x255a0e13-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:37,864 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:37,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x042405c0 to 127.0.0.1:53257 2023-10-01 21:02:37,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:37,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-01 21:02:37,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:02:37,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 21:02:37,872 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:02:37,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 21:02:37,874 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 21:02:37,874 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696194757874 2023-10-01 21:02:37,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-01 21:02:37,878 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:02:37,878 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:02:37,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 21:02:37,879 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-01 21:02:37,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-01 21:02:37,881 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 21:02:37,881 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696194757881 2023-10-01 21:02:37,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,894 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-01 21:02:37,894 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:37,895 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-01 21:02:37,895 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-01 21:02:37,895 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,895 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,896 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:37,896 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:37,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:37,896 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,896 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:37,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:37,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:37,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:37,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:37,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:37,897 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,897 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:02:37,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,898 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 21:02:37,898 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 21:02:37,898 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:37,898 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:37,899 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 21:02:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 21:02:37,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 21:02:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-01 21:02:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 21:02:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:37,900 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 21:02:37,901 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 21:02:37,901 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-01 21:02:37,901 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-01 21:02:37,901 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-01 21:02:37,902 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,902 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:37,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:37,903 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,905 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,905 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:37,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:37,905 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,905 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,905 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:37,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:37,905 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,905 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:37,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-01 21:02:37,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@300b0df7[Count = 0] remaining members to acquire global barrier 2023-10-01 21:02:37,907 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-01 21:02:37,907 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,908 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,908 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,908 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,908 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 21:02:37,908 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 21:02:37,908 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 21:02:37,908 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 21:02:37,908 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,908 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:02:37,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,908 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:02:37,908 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:02:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-01 21:02:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:37,909 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. 2023-10-01 21:02:37,909 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. started... 2023-10-01 21:02:37,910 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4095c5f64f061d5b4d6342f39218f502: 2023-10-01 21:02:37,910 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,910 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:37,910 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf/06aa1b57d7ab4b7ea66f3143563278e7.7a17f1906c8397e88d554c6d5c5e5768->hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/cf/06aa1b57d7ab4b7ea66f3143563278e7-top, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf/91743ad58a5c4a969c13506106704c09.cf1fa8792ef45f298179f421d22c0a25->hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/cf/91743ad58a5c4a969c13506106704c09-top] hfiles 2023-10-01 21:02:37,910 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf/06aa1b57d7ab4b7ea66f3143563278e7.7a17f1906c8397e88d554c6d5c5e5768 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,911 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 21:02:37,911 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 21:02:37,911 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf/91743ad58a5c4a969c13506106704c09.cf1fa8792ef45f298179f421d22c0a25 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,911 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:37,911 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:37,911 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 21:02:37,912 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 21:02:37,921 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. completed. 2023-10-01 21:02:37,921 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. 2023-10-01 21:02:37,921 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:37,921 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:37,921 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,921 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-01 21:02:37,921 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:02:37,927 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-01 21:02:37,927 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,927 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:37,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:37,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:37,927 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-01 21:02:37,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:37,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:37,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:37,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:37,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:02:37,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-01 21:02:37,930 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-01 21:02:37,930 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:02:37,930 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:02:37,930 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,930 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:02:37,931 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,931 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:37,931 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,931 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,932 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:37,931 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:37,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,932 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:37,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:37,932 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:37,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:37,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,933 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:37,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:37,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,933 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:37,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:37,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:37,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:37,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,935 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,936 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:37,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:37,936 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:37,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:37,938 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:37,938 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,938 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:37,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:37,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:37,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:37,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:37,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:37,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:37,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:37,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:37,938 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:37,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:37,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:37,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:37,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:37,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:37,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:37,939 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:37,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,939 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:37,940 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:37,940 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,940 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:37,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:37,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:37,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:37,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,960 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-01 21:02:37,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,961 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:37,961 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696194157875Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696194157939 (+64 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696194157939Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696194157942 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696194157951 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696194157960 (+9 ms) 2023-10-01 21:02:37,963 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-01 21:02:37,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 85 msec 2023-10-01 21:02:37,978 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:37,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-01 21:02:37,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:02:37,979 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194157979 2023-10-01 21:02:37,979 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33955, tgtDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194157979, rawTgtDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194157979, srcFsUri=hdfs://localhost:33955, srcDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:02:38,009 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:02:38,010 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2005998560_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194157979, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194157979/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:38,010 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89, snapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-01 21:02:38,018 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194157979/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:38,032 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,033 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,033 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,033 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,676 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0004_000001 (auth:SIMPLE) 2023-10-01 21:02:38,914 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-2314710666855192785.jar 2023-10-01 21:02:38,914 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,916 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,982 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-2490217912216756168.jar 2023-10-01 21:02:38,983 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,983 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,984 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,984 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,984 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,985 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:38,985 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 21:02:38,986 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 21:02:38,986 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 21:02:38,987 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 21:02:38,987 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 21:02:38,987 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 21:02:38,988 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 21:02:38,988 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 21:02:38,988 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 21:02:38,989 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 21:02:38,989 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:38,990 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:38,990 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:38,990 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:38,991 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:38,991 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:38,992 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:39,328 WARN [Listener at jenkins-hbase4.apache.org/42645] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 21:02:39,330 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-01 21:02:39,332 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-01 21:02:39,387 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:02:39,387 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:02:39,623 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0005_000001 (auth:SIMPLE) 2023-10-01 21:02:40,022 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 21:02:43,293 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0005_000001 (auth:SIMPLE) 2023-10-01 21:02:45,512 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0005_000001 (auth:SIMPLE) 2023-10-01 21:02:47,803 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0005_000001 (auth:SIMPLE) 2023-10-01 21:02:49,504 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 21:02:49,507 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 21:02:49,515 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,515 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 21:02:49,515 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 21:02:49,515 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,516 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-01 21:02:49,516 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-01 21:02:49,516 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194157979/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194157979/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,516 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194157979/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-01 21:02:49,517 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194157979/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-01 21:02:49,523 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 21:02:49,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194169527"}]},"ts":"1696194169527"} 2023-10-01 21:02:49,529 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-01 21:02:49,530 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-01 21:02:49,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4095c5f64f061d5b4d6342f39218f502, UNASSIGN}] 2023-10-01 21:02:49,533 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4095c5f64f061d5b4d6342f39218f502, UNASSIGN 2023-10-01 21:02:49,533 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4095c5f64f061d5b4d6342f39218f502, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:49,533 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696194169533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194169533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194169533"}]},"ts":"1696194169533"} 2023-10-01 21:02:49,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4095c5f64f061d5b4d6342f39218f502, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:02:49,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 21:02:49,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:49,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4095c5f64f061d5b4d6342f39218f502, disabling compactions & flushes 2023-10-01 21:02:49,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. 2023-10-01 21:02:49,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. 2023-10-01 21:02:49,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. after waiting 0 ms 2023-10-01 21:02:49,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. 2023-10-01 21:02:49,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-01 21:02:49,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:02:49,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502. 2023-10-01 21:02:49,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4095c5f64f061d5b4d6342f39218f502: 2023-10-01 21:02:49,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:49,701 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4095c5f64f061d5b4d6342f39218f502, regionState=CLOSED 2023-10-01 21:02:49,701 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696194169701"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194169701"}]},"ts":"1696194169701"} 2023-10-01 21:02:49,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-01 21:02:49,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4095c5f64f061d5b4d6342f39218f502, server=jenkins-hbase4.apache.org,35853,1696194083102 in 167 msec 2023-10-01 21:02:49,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-01 21:02:49,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4095c5f64f061d5b4d6342f39218f502, UNASSIGN in 173 msec 2023-10-01 21:02:49,706 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194169706"}]},"ts":"1696194169706"} 2023-10-01 21:02:49,707 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-01 21:02:49,708 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-01 21:02:49,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 186 msec 2023-10-01 21:02:49,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-01 21:02:49,829 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-01 21:02:49,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,833 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,833 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,835 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,838 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,838 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,838 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,838 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 21:02:49,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 21:02:49,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 21:02:49,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-01 21:02:49,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:49,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:49,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:49,839 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:49,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-01 21:02:49,840 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:49,840 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:49,841 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:49,841 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:49,841 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:49,841 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:49,841 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:49,843 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/recovered.edits] 2023-10-01 21:02:49,843 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/recovered.edits] 2023-10-01 21:02:49,843 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/recovered.edits] 2023-10-01 21:02:49,847 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf/06aa1b57d7ab4b7ea66f3143563278e7.7a17f1906c8397e88d554c6d5c5e5768 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf/06aa1b57d7ab4b7ea66f3143563278e7.7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:49,848 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/cf/91743ad58a5c4a969c13506106704c09 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/cf/91743ad58a5c4a969c13506106704c09 2023-10-01 21:02:49,848 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/cf/06aa1b57d7ab4b7ea66f3143563278e7 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/cf/06aa1b57d7ab4b7ea66f3143563278e7 2023-10-01 21:02:49,849 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf/91743ad58a5c4a969c13506106704c09.cf1fa8792ef45f298179f421d22c0a25 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/cf/91743ad58a5c4a969c13506106704c09.cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:49,852 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/recovered.edits/8.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768/recovered.edits/8.seqid 2023-10-01 21:02:49,852 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/recovered.edits/8.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25/recovered.edits/8.seqid 2023-10-01 21:02:49,853 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/recovered.edits/12.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502/recovered.edits/12.seqid 2023-10-01 21:02:49,853 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a17f1906c8397e88d554c6d5c5e5768 2023-10-01 21:02:49,853 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cf1fa8792ef45f298179f421d22c0a25 2023-10-01 21:02:49,853 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4095c5f64f061d5b4d6342f39218f502 2023-10-01 21:02:49,853 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-01 21:02:49,855 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,857 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-01 21:02:49,859 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-01 21:02:49,860 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,860 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-01 21:02:49,860 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194169860"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:49,861 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-01 21:02:49,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4095c5f64f061d5b4d6342f39218f502, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696194156099.4095c5f64f061d5b4d6342f39218f502.', STARTKEY => '', ENDKEY => ''}] 2023-10-01 21:02:49,862 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-01 21:02:49,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696194169862"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:49,863 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-01 21:02:49,865 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:49,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 35 msec 2023-10-01 21:02:49,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-01 21:02:49,942 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-01 21:02:49,942 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:49,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:49,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:49,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 21:02:49,947 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194169947"}]},"ts":"1696194169947"} 2023-10-01 21:02:49,948 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-01 21:02:49,949 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-01 21:02:49,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=585bbbec2ab31babaeaeaf0545f0a185, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=22ea4fe837c4044f8a8a138a535de0de, UNASSIGN}] 2023-10-01 21:02:49,951 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=585bbbec2ab31babaeaeaf0545f0a185, UNASSIGN 2023-10-01 21:02:49,952 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=22ea4fe837c4044f8a8a138a535de0de, UNASSIGN 2023-10-01 21:02:49,953 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=585bbbec2ab31babaeaeaf0545f0a185, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:49,953 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=22ea4fe837c4044f8a8a138a535de0de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:49,953 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696194169953"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194169953"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194169953"}]},"ts":"1696194169953"} 2023-10-01 21:02:49,953 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696194169953"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194169953"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194169953"}]},"ts":"1696194169953"} 2023-10-01 21:02:49,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 585bbbec2ab31babaeaeaf0545f0a185, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:02:49,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 22ea4fe837c4044f8a8a138a535de0de, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:02:50,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 21:02:50,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:50,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:50,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 585bbbec2ab31babaeaeaf0545f0a185, disabling compactions & flushes 2023-10-01 21:02:50,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 22ea4fe837c4044f8a8a138a535de0de, disabling compactions & flushes 2023-10-01 21:02:50,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:50,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:50,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:50,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:50,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. after waiting 0 ms 2023-10-01 21:02:50,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:50,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. after waiting 0 ms 2023-10-01 21:02:50,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:50,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:02:50,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:02:50,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:02:50,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:02:50,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185. 2023-10-01 21:02:50,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 585bbbec2ab31babaeaeaf0545f0a185: 2023-10-01 21:02:50,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de. 2023-10-01 21:02:50,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 22ea4fe837c4044f8a8a138a535de0de: 2023-10-01 21:02:50,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:50,120 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=585bbbec2ab31babaeaeaf0545f0a185, regionState=CLOSED 2023-10-01 21:02:50,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:50,120 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696194170120"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194170120"}]},"ts":"1696194170120"} 2023-10-01 21:02:50,120 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=22ea4fe837c4044f8a8a138a535de0de, regionState=CLOSED 2023-10-01 21:02:50,121 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696194170120"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194170120"}]},"ts":"1696194170120"} 2023-10-01 21:02:50,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-01 21:02:50,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 585bbbec2ab31babaeaeaf0545f0a185, server=jenkins-hbase4.apache.org,35853,1696194083102 in 167 msec 2023-10-01 21:02:50,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-01 21:02:50,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 22ea4fe837c4044f8a8a138a535de0de, server=jenkins-hbase4.apache.org,39185,1696194083151 in 167 msec 2023-10-01 21:02:50,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=585bbbec2ab31babaeaeaf0545f0a185, UNASSIGN in 173 msec 2023-10-01 21:02:50,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-01 21:02:50,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=22ea4fe837c4044f8a8a138a535de0de, UNASSIGN in 174 msec 2023-10-01 21:02:50,125 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194170125"}]},"ts":"1696194170125"} 2023-10-01 21:02:50,126 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-01 21:02:50,132 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-01 21:02:50,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 189 msec 2023-10-01 21:02:50,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-01 21:02:50,249 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-01 21:02:50,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,251 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,252 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,253 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,255 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,255 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,255 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,255 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,256 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 21:02:50,256 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 21:02:50,256 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-01 21:02:50,256 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:50,256 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:50,256 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,256 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,256 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:50,256 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-10-01 21:02:50,257 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 21:02:50,256 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:50,256 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:50,256 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,257 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:50,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-01 21:02:50,258 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/recovered.edits] 2023-10-01 21:02:50,258 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/recovered.edits] 2023-10-01 21:02:50,262 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/cf/75ae4e4aef984b46ad419fd701ef8537 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/cf/75ae4e4aef984b46ad419fd701ef8537 2023-10-01 21:02:50,262 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/cf/c7588de785784a528753fda84daed4da to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/cf/c7588de785784a528753fda84daed4da 2023-10-01 21:02:50,264 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de/recovered.edits/9.seqid 2023-10-01 21:02:50,264 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185/recovered.edits/9.seqid 2023-10-01 21:02:50,265 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/22ea4fe837c4044f8a8a138a535de0de 2023-10-01 21:02:50,265 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/585bbbec2ab31babaeaeaf0545f0a185 2023-10-01 21:02:50,265 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-01 21:02:50,265 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-01 21:02:50,266 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-01 21:02:50,269 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231001569894843a7d4428bd6ec0e5a6d843af to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231001569894843a7d4428bd6ec0e5a6d843af 2023-10-01 21:02:50,270 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231001ad5db2c79cfc4e258bdfaf89e3b9f50f to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231001ad5db2c79cfc4e258bdfaf89e3b9f50f 2023-10-01 21:02:50,270 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-01 21:02:50,272 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,274 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-01 21:02:50,275 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-01 21:02:50,276 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,276 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-01 21:02:50,276 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194170276"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:50,276 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194170276"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:50,277 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 21:02:50,278 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 585bbbec2ab31babaeaeaf0545f0a185, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696194154743.585bbbec2ab31babaeaeaf0545f0a185.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 22ea4fe837c4044f8a8a138a535de0de, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696194154743.22ea4fe837c4044f8a8a138a535de0de.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 21:02:50,278 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-01 21:02:50,278 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696194170278"}]},"ts":"9223372036854775807"} 2023-10-01 21:02:50,279 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-01 21:02:50,281 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 32 msec 2023-10-01 21:02:50,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-01 21:02:50,359 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-01 21:02:50,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-01 21:02:50,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-01 21:02:50,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-01 21:02:50,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-01 21:02:50,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-01 21:02:50,397 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 749) Potentially hanging thread: hconnection-0x67090907-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:37494 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:38263 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-524727784_1 at /127.0.0.1:48190 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:53150 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:37500 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3955 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:48220 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=134 (was 163), ProcessCount=168 (was 170), AvailableMemoryMB=1291 (was 1342) 2023-10-01 21:02:50,398 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-10-01 21:02:50,417 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=168, AvailableMemoryMB=1291 2023-10-01 21:02:50,417 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-10-01 21:02:50,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 21:02:50,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 21:02:50,421 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 21:02:50,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-01 21:02:50,422 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 21:02:50,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 21:02:50,424 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:02:50,424 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:02:50,424 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97 empty. 2023-10-01 21:02:50,424 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1 empty. 2023-10-01 21:02:50,425 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:02:50,425 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:02:50,425 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-01 21:02:50,433 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-01 21:02:50,434 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 86d551fe315bd020d192f971b4ea4b97, NAME => 'testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:02:50,435 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e0ba5644af0c9c365d970c026bb19fe1, NAME => 'testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:02:50,442 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:50,442 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:50,442 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 86d551fe315bd020d192f971b4ea4b97, disabling compactions & flushes 2023-10-01 21:02:50,443 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e0ba5644af0c9c365d970c026bb19fe1, disabling compactions & flushes 2023-10-01 21:02:50,443 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:50,443 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:50,443 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:50,443 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. after waiting 0 ms 2023-10-01 21:02:50,443 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:50,443 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:50,443 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:50,443 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 86d551fe315bd020d192f971b4ea4b97: 2023-10-01 21:02:50,443 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. after waiting 0 ms 2023-10-01 21:02:50,443 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:50,443 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:50,443 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e0ba5644af0c9c365d970c026bb19fe1: 2023-10-01 21:02:50,445 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 21:02:50,446 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696194170446"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194170446"}]},"ts":"1696194170446"} 2023-10-01 21:02:50,446 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696194170446"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194170446"}]},"ts":"1696194170446"} 2023-10-01 21:02:50,448 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 21:02:50,448 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 21:02:50,448 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194170448"}]},"ts":"1696194170448"} 2023-10-01 21:02:50,449 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-01 21:02:50,452 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 21:02:50,453 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 21:02:50,453 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 21:02:50,453 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 21:02:50,453 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 21:02:50,453 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=86d551fe315bd020d192f971b4ea4b97, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0ba5644af0c9c365d970c026bb19fe1, ASSIGN}] 2023-10-01 21:02:50,456 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0ba5644af0c9c365d970c026bb19fe1, ASSIGN 2023-10-01 21:02:50,456 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=86d551fe315bd020d192f971b4ea4b97, ASSIGN 2023-10-01 21:02:50,456 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0ba5644af0c9c365d970c026bb19fe1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39185,1696194083151; forceNewPlan=false, retain=false 2023-10-01 21:02:50,456 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=86d551fe315bd020d192f971b4ea4b97, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35853,1696194083102; forceNewPlan=false, retain=false 2023-10-01 21:02:50,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 21:02:50,606 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 21:02:50,609 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e0ba5644af0c9c365d970c026bb19fe1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:50,609 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=86d551fe315bd020d192f971b4ea4b97, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:50,609 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696194170609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194170609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194170609"}]},"ts":"1696194170609"} 2023-10-01 21:02:50,609 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696194170609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194170609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194170609"}]},"ts":"1696194170609"} 2023-10-01 21:02:50,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure e0ba5644af0c9c365d970c026bb19fe1, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:02:50,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 86d551fe315bd020d192f971b4ea4b97, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:02:50,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 21:02:50,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:50,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0ba5644af0c9c365d970c026bb19fe1, NAME => 'testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 21:02:50,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. service=AccessControlService 2023-10-01 21:02:50,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:02:50,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:50,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:02:50,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 86d551fe315bd020d192f971b4ea4b97, NAME => 'testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 21:02:50,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:50,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:02:50,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:02:50,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. service=AccessControlService 2023-10-01 21:02:50,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:02:50,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:02:50,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:02:50,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:02:50,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:02:50,767 INFO [StoreOpener-e0ba5644af0c9c365d970c026bb19fe1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:02:50,767 INFO [StoreOpener-86d551fe315bd020d192f971b4ea4b97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:02:50,768 DEBUG [StoreOpener-e0ba5644af0c9c365d970c026bb19fe1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/cf 2023-10-01 21:02:50,768 DEBUG [StoreOpener-e0ba5644af0c9c365d970c026bb19fe1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/cf 2023-10-01 21:02:50,768 DEBUG [StoreOpener-86d551fe315bd020d192f971b4ea4b97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/cf 2023-10-01 21:02:50,768 DEBUG [StoreOpener-86d551fe315bd020d192f971b4ea4b97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/cf 2023-10-01 21:02:50,768 INFO [StoreOpener-e0ba5644af0c9c365d970c026bb19fe1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0ba5644af0c9c365d970c026bb19fe1 columnFamilyName cf 2023-10-01 21:02:50,769 INFO [StoreOpener-86d551fe315bd020d192f971b4ea4b97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86d551fe315bd020d192f971b4ea4b97 columnFamilyName cf 2023-10-01 21:02:50,770 INFO [StoreOpener-86d551fe315bd020d192f971b4ea4b97-1] regionserver.HStore(310): Store=86d551fe315bd020d192f971b4ea4b97/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:02:50,770 INFO [StoreOpener-e0ba5644af0c9c365d970c026bb19fe1-1] regionserver.HStore(310): Store=e0ba5644af0c9c365d970c026bb19fe1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:02:50,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:02:50,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:02:50,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:02:50,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:02:50,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:02:50,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:02:50,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:02:50,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:02:50,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e0ba5644af0c9c365d970c026bb19fe1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69101218, jitterRate=0.029688388109207153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:02:50,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e0ba5644af0c9c365d970c026bb19fe1: 2023-10-01 21:02:50,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 86d551fe315bd020d192f971b4ea4b97; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71238636, jitterRate=0.06153839826583862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:02:50,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 86d551fe315bd020d192f971b4ea4b97: 2023-10-01 21:02:50,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1., pid=93, masterSystemTime=1696194170762 2023-10-01 21:02:50,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:50,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:50,778 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e0ba5644af0c9c365d970c026bb19fe1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:50,778 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696194170778"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194170778"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194170778"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194170778"}]},"ts":"1696194170778"} 2023-10-01 21:02:50,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97., pid=94, masterSystemTime=1696194170763 2023-10-01 21:02:50,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-01 21:02:50,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure e0ba5644af0c9c365d970c026bb19fe1, server=jenkins-hbase4.apache.org,39185,1696194083151 in 169 msec 2023-10-01 21:02:50,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:50,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:50,782 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=86d551fe315bd020d192f971b4ea4b97, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:50,783 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696194170782"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194170782"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194170782"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194170782"}]},"ts":"1696194170782"} 2023-10-01 21:02:50,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0ba5644af0c9c365d970c026bb19fe1, ASSIGN in 329 msec 2023-10-01 21:02:50,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-01 21:02:50,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 86d551fe315bd020d192f971b4ea4b97, server=jenkins-hbase4.apache.org,35853,1696194083102 in 173 msec 2023-10-01 21:02:50,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-01 21:02:50,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=86d551fe315bd020d192f971b4ea4b97, ASSIGN in 332 msec 2023-10-01 21:02:50,787 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 21:02:50,787 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194170787"}]},"ts":"1696194170787"} 2023-10-01 21:02:50,788 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-01 21:02:50,790 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 21:02:50,790 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-01 21:02:50,791 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 21:02:50,794 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:50,794 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:50,794 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:50,794 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:02:50,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:50,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:50,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:50,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-01 21:02:50,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 377 msec 2023-10-01 21:02:51,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-01 21:02:51,025 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-01 21:02:51,027 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-01 21:02:51,027 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:51,029 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:02:51,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:02:51,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194171039 (current time:1696194171039). 2023-10-01 21:02:51,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:02:51,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x5bce586e to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:51,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c828fae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:51,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:51,052 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:51,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bce586e to 127.0.0.1:53257 2023-10-01 21:02:51,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:51,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x200702c5 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:51,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9a32383, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:51,061 DEBUG [hconnection-0x419432e6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:51,062 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:51,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x200702c5 to 127.0.0.1:53257 2023-10-01 21:02:51,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:51,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 21:02:51,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:02:51,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:02:51,069 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:02:51,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:02:51,074 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:02:51,074 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696194771074 2023-10-01 21:02:51,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:02:51,074 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-01 21:02:51,075 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:02:51,075 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:02:51,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 21:02:51,076 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:02:51,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-01 21:02:51,080 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 21:02:51,080 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696194771080 2023-10-01 21:02:51,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,088 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-01 21:02:51,088 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:51,089 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-01 21:02:51,089 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-01 21:02:51,090 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,090 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,097 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,097 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,097 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,097 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,098 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,098 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,098 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,098 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:02:51,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 21:02:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,099 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 21:02:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 21:02:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-01 21:02:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,099 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 21:02:51,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,099 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 21:02:51,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,099 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 21:02:51,099 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:51,099 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 21:02:51,100 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 21:02:51,100 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 21:02:51,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,100 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 21:02:51,100 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 21:02:51,100 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:51,100 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:51,101 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 21:02:51,102 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 21:02:51,102 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 21:02:51,102 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 21:02:51,102 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 21:02:51,102 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 21:02:51,104 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,104 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,104 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,104 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,104 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:51,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:51,104 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,104 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,105 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,105 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:51,105 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,105 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:51,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 21:02:51,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e0bcf54[Count = 1] remaining members to acquire global barrier 2023-10-01 21:02:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:51,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 21:02:51,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e0bcf54[Count = 0] remaining members to acquire global barrier 2023-10-01 21:02:51,109 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 21:02:51,109 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,111 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,111 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,111 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:02:51,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:02:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:02:51,112 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:51,112 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:51,112 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. started... 2023-10-01 21:02:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 21:02:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:51,113 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0ba5644af0c9c365d970c026bb19fe1: 2023-10-01 21:02:51,113 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,113 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:02:51,113 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:02:51,112 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:51,114 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:51,114 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. started... 2023-10-01 21:02:51,114 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:02:51,114 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 86d551fe315bd020d192f971b4ea4b97: 2023-10-01 21:02:51,114 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,114 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:51,114 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:02:51,115 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 21:02:51,115 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:51,115 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 21:02:51,127 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. completed. 2023-10-01 21:02:51,127 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:51,127 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:51,127 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:51,127 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,127 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. completed. 2023-10-01 21:02:51,128 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 21:02:51,128 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:51,128 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:02:51,128 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:51,128 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:51,128 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,128 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 21:02:51,128 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:02:51,129 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 21:02:51,129 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:51,129 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,129 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 21:02:51,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:51,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:51,130 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,130 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 21:02:51,130 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:51,130 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 21:02:51,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:51,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:51,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:51,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39185,1696194083151': 2023-10-01 21:02:51,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 21:02:51,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:51,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:51,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:51,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:51,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:02:51,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 21:02:51,137 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-01 21:02:51,137 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:02:51,137 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:02:51,137 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,137 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:02:51,140 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:51,140 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,140 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,140 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,140 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,141 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,141 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:51,143 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,143 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,143 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,145 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,146 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,146 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,146 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:51,146 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,146 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,146 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,146 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,146 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,147 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-01 21:02:51,147 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,147 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:02:51,147 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,147 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,147 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,147 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,147 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,148 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,148 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 21:02:51,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,174 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-01 21:02:51,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,175 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696194171074Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696194171154 (+80 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696194171154Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696194171155 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696194171158 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696194171169 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696194171174 (+5 ms) 2023-10-01 21:02:51,176 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:51,177 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 21:02:51,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 21:02:51,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:02:51,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 102 msec 2023-10-01 21:02:51,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35853] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:02:51,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39185] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:02:51,183 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-01 21:02:51,183 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:51,183 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:02:51,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:02:51,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194171193 (current time:1696194171193). 2023-10-01 21:02:51,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:02:51,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x7a45cefd to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:51,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@363f16f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:51,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:51,202 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:51,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a45cefd to 127.0.0.1:53257 2023-10-01 21:02:51,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:51,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x4e2c181b to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:02:51,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1aca0505, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:02:51,211 DEBUG [hconnection-0x540c2017-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:02:51,213 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:02:51,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e2c181b to 127.0.0.1:53257 2023-10-01 21:02:51,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:02:51,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-01 21:02:51,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:02:51,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:02:51,220 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:02:51,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:02:51,222 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:02:51,223 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696194771223 2023-10-01 21:02:51,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-01 21:02:51,223 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-01 21:02:51,224 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:02:51,224 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:02:51,225 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-01 21:02:51,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 21:02:51,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-01 21:02:51,227 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 21:02:51,227 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696194771227 2023-10-01 21:02:51,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,238 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-01 21:02:51,238 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:51,239 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-01 21:02:51,239 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-01 21:02:51,240 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,240 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,241 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,241 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,241 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,241 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,241 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,242 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,242 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,242 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 21:02:51,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,243 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-01 21:02:51,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,243 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 21:02:51,243 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 21:02:51,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,243 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:51,243 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-01 21:02:51,243 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:51,243 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:02:51,245 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 21:02:51,245 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 21:02:51,244 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 21:02:51,248 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 21:02:51,248 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 21:02:51,248 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-01 21:02:51,248 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-01 21:02:51,248 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 21:02:51,248 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-01 21:02:51,249 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,249 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:51,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:51,251 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,251 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:51,251 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,251 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:51,251 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,252 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:51,252 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:51,252 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,252 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:02:51,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:51,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 21:02:51,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37d9cdea[Count = 1] remaining members to acquire global barrier 2023-10-01 21:02:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:51,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:51,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:51,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-01 21:02:51,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37d9cdea[Count = 0] remaining members to acquire global barrier 2023-10-01 21:02:51,256 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-01 21:02:51,256 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,260 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,260 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,260 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,260 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:02:51,260 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:02:51,260 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,260 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 21:02:51,260 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:02:51,260 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:51,260 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:51,261 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:51,260 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-01 21:02:51,261 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. started... 2023-10-01 21:02:51,261 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,261 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:02:51,261 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:02:51,261 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 86d551fe315bd020d192f971b4ea4b97 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-01 21:02:51,261 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:51,261 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:02:51,261 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. started... 2023-10-01 21:02:51,261 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e0ba5644af0c9c365d970c026bb19fe1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-01 21:02:51,262 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 21:02:51,262 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:51,262 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 21:02:51,285 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100144029685261945aebdab4afc92be56d0 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100144029685261945aebdab4afc92be56d0 2023-10-01 21:02:51,285 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231001f8abf502fdc6456eba1b859f7a970f6f to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001f8abf502fdc6456eba1b859f7a970f6f 2023-10-01 21:02:51,293 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/.tmp/cf/7006d79f396b4ea5b65ca257327bfef8 2023-10-01 21:02:51,298 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/.tmp/cf/7006d79f396b4ea5b65ca257327bfef8 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/cf/7006d79f396b4ea5b65ca257327bfef8 2023-10-01 21:02:51,301 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/.tmp/cf/2b7d2156041146e782c39068555fea11 2023-10-01 21:02:51,303 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/cf/7006d79f396b4ea5b65ca257327bfef8, entries=47, sequenceid=6, filesize=13.1 K 2023-10-01 21:02:51,304 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for e0ba5644af0c9c365d970c026bb19fe1 in 43ms, sequenceid=6, compaction requested=false 2023-10-01 21:02:51,304 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-01 21:02:51,305 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0ba5644af0c9c365d970c026bb19fe1: 2023-10-01 21:02:51,305 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,305 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:51,305 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/cf/7006d79f396b4ea5b65ca257327bfef8] hfiles 2023-10-01 21:02:51,305 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/cf/7006d79f396b4ea5b65ca257327bfef8 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,306 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/.tmp/cf/2b7d2156041146e782c39068555fea11 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/cf/2b7d2156041146e782c39068555fea11 2023-10-01 21:02:51,311 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/cf/2b7d2156041146e782c39068555fea11, entries=3, sequenceid=6, filesize=5.4 K 2023-10-01 21:02:51,312 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 86d551fe315bd020d192f971b4ea4b97 in 51ms, sequenceid=6, compaction requested=false 2023-10-01 21:02:51,314 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 86d551fe315bd020d192f971b4ea4b97: 2023-10-01 21:02:51,314 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,314 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:02:51,314 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/cf/2b7d2156041146e782c39068555fea11] hfiles 2023-10-01 21:02:51,314 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/cf/2b7d2156041146e782c39068555fea11 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,316 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. completed. 2023-10-01 21:02:51,316 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:02:51,317 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:51,317 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:51,317 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,317 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 21:02:51,317 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:02:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 21:02:51,318 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 21:02:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,322 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. completed. 2023-10-01 21:02:51,322 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:02:51,322 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:02:51,322 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:02:51,322 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,322 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-01 21:02:51,322 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:02:51,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:51,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,324 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:51,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,324 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,324 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-01 21:02:51,325 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:51,325 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-01 21:02:51,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 21:02:51,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:02:51,327 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 21:02:51,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39185,1696194083151': 2023-10-01 21:02:51,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-01 21:02:51,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:51,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:51,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:51,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:51,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:51,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:02:51,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-01 21:02:51,330 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-01 21:02:51,330 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:02:51,330 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:02:51,330 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,330 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:02:51,331 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,331 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,331 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,331 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,331 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:02:51,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:02:51,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,332 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,331 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,332 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:02:51,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,332 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,333 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:02:51,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,335 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:02:51,336 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,336 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,338 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,338 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,338 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,338 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,338 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,338 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,338 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:02:51,338 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,339 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:02:51,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,338 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-01 21:02:51,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,339 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:02:51,338 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:02:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:02:51,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:02:51,340 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:02:51,340 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,340 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:02:51,340 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:02:51,340 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,340 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:02:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:02:51,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001f8abf502fdc6456eba1b859f7a970f6f, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100144029685261945aebdab4afc92be56d0] mob files 2023-10-01 21:02:51,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001f8abf502fdc6456eba1b859f7a970f6f 2023-10-01 21:02:51,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100144029685261945aebdab4afc92be56d0 2023-10-01 21:02:51,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-01 21:02:51,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,377 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696194171223Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696194171347 (+124 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696194171347Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696194171347Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696194171357 (+10 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696194171370 (+13 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696194171376 (+6 ms) 2023-10-01 21:02:51,379 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-01 21:02:51,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 155 msec 2023-10-01 21:02:51,527 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:02:51,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-01 21:02:51,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:02:51,528 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194171528 2023-10-01 21:02:51,528 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33955, tgtDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194171528, rawTgtDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194171528, srcFsUri=hdfs://localhost:33955, srcDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:02:51,550 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:02:51,550 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_303619568_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194171528, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194171528/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,550 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89, snapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-01 21:02:51,555 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194171528/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:02:51,572 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:51,573 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:51,573 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:51,573 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:52,445 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-5213100536124560426.jar 2023-10-01 21:02:52,445 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:52,446 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:52,512 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-4182631304855645568.jar 2023-10-01 21:02:52,512 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:52,513 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:52,513 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:52,514 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:52,514 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:52,514 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 21:02:52,515 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 21:02:52,515 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 21:02:52,515 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 21:02:52,516 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 21:02:52,516 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 21:02:52,516 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 21:02:52,517 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 21:02:52,517 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 21:02:52,517 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 21:02:52,518 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 21:02:52,518 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:52,519 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:52,519 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:52,519 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:52,520 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:02:52,520 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:52,521 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:02:52,858 WARN [Listener at jenkins-hbase4.apache.org/42645] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 21:02:52,860 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-01 21:02:53,973 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:02:53,973 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:02:53,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0005_000001 (auth:SIMPLE) 2023-10-01 21:02:54,685 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0006_000001 (auth:SIMPLE) 2023-10-01 21:02:55,285 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 21:02:58,390 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0006_000001 (auth:SIMPLE) 2023-10-01 21:03:01,199 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 21:03:01,200 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 21:03:01,205 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:03:01,205 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 21:03:01,206 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 21:03:01,206 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:03:01,206 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-01 21:03:01,207 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-01 21:03:01,207 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194171528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194171528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:03:01,207 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194171528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-01 21:03:01,207 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194171528/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-01 21:03:01,213 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 21:03:01,218 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194181218"}]},"ts":"1696194181218"} 2023-10-01 21:03:01,220 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-01 21:03:01,221 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-01 21:03:01,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=86d551fe315bd020d192f971b4ea4b97, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0ba5644af0c9c365d970c026bb19fe1, UNASSIGN}] 2023-10-01 21:03:01,226 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0ba5644af0c9c365d970c026bb19fe1, UNASSIGN 2023-10-01 21:03:01,227 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=86d551fe315bd020d192f971b4ea4b97, UNASSIGN 2023-10-01 21:03:01,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e0ba5644af0c9c365d970c026bb19fe1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:01,227 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=86d551fe315bd020d192f971b4ea4b97, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:01,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696194181227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194181227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194181227"}]},"ts":"1696194181227"} 2023-10-01 21:03:01,227 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696194181227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194181227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194181227"}]},"ts":"1696194181227"} 2023-10-01 21:03:01,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure e0ba5644af0c9c365d970c026bb19fe1, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:03:01,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 86d551fe315bd020d192f971b4ea4b97, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:03:01,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 21:03:01,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:03:01,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:03:01,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e0ba5644af0c9c365d970c026bb19fe1, disabling compactions & flushes 2023-10-01 21:03:01,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 86d551fe315bd020d192f971b4ea4b97, disabling compactions & flushes 2023-10-01 21:03:01,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:03:01,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:03:01,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. after waiting 0 ms 2023-10-01 21:03:01,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:03:01,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:03:01,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:03:01,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. after waiting 0 ms 2023-10-01 21:03:01,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:03:01,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:03:01,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:03:01,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:01,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:01,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97. 2023-10-01 21:03:01,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1. 2023-10-01 21:03:01,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 86d551fe315bd020d192f971b4ea4b97: 2023-10-01 21:03:01,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e0ba5644af0c9c365d970c026bb19fe1: 2023-10-01 21:03:01,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:03:01,393 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=86d551fe315bd020d192f971b4ea4b97, regionState=CLOSED 2023-10-01 21:03:01,393 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696194181393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194181393"}]},"ts":"1696194181393"} 2023-10-01 21:03:01,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:03:01,393 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e0ba5644af0c9c365d970c026bb19fe1, regionState=CLOSED 2023-10-01 21:03:01,394 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696194181393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194181393"}]},"ts":"1696194181393"} 2023-10-01 21:03:01,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-10-01 21:03:01,397 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 86d551fe315bd020d192f971b4ea4b97, server=jenkins-hbase4.apache.org,35853,1696194083102 in 165 msec 2023-10-01 21:03:01,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-10-01 21:03:01,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure e0ba5644af0c9c365d970c026bb19fe1, server=jenkins-hbase4.apache.org,39185,1696194083151 in 166 msec 2023-10-01 21:03:01,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=86d551fe315bd020d192f971b4ea4b97, UNASSIGN in 175 msec 2023-10-01 21:03:01,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-01 21:03:01,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0ba5644af0c9c365d970c026bb19fe1, UNASSIGN in 175 msec 2023-10-01 21:03:01,400 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194181400"}]},"ts":"1696194181400"} 2023-10-01 21:03:01,402 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-01 21:03:01,403 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-01 21:03:01,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 190 msec 2023-10-01 21:03:01,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-01 21:03:01,520 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-01 21:03:01,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,525 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,526 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,527 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,530 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:03:01,530 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:03:01,530 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,530 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,530 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,530 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,531 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 21:03:01,531 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 21:03:01,531 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-01 21:03:01,532 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,532 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,532 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:01,532 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:01,532 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-10-01 21:03:01,532 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,532 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:01,532 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-01 21:03:01,532 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:01,533 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/recovered.edits] 2023-10-01 21:03:01,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-01 21:03:01,533 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/recovered.edits] 2023-10-01 21:03:01,537 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/cf/2b7d2156041146e782c39068555fea11 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/cf/2b7d2156041146e782c39068555fea11 2023-10-01 21:03:01,537 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/cf/7006d79f396b4ea5b65ca257327bfef8 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/cf/7006d79f396b4ea5b65ca257327bfef8 2023-10-01 21:03:01,540 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97/recovered.edits/9.seqid 2023-10-01 21:03:01,540 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1/recovered.edits/9.seqid 2023-10-01 21:03:01,541 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/86d551fe315bd020d192f971b4ea4b97 2023-10-01 21:03:01,541 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0ba5644af0c9c365d970c026bb19fe1 2023-10-01 21:03:01,541 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-01 21:03:01,541 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-01 21:03:01,542 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-01 21:03:01,545 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001f8abf502fdc6456eba1b859f7a970f6f to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231001f8abf502fdc6456eba1b859f7a970f6f 2023-10-01 21:03:01,546 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100144029685261945aebdab4afc92be56d0 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100144029685261945aebdab4afc92be56d0 2023-10-01 21:03:01,547 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-01 21:03:01,549 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,551 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-01 21:03:01,553 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-01 21:03:01,553 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,554 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-01 21:03:01,554 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194181554"}]},"ts":"9223372036854775807"} 2023-10-01 21:03:01,554 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194181554"}]},"ts":"9223372036854775807"} 2023-10-01 21:03:01,555 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 21:03:01,555 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 86d551fe315bd020d192f971b4ea4b97, NAME => 'testtb-testEmptyExportFileSystemState,,1696194170418.86d551fe315bd020d192f971b4ea4b97.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e0ba5644af0c9c365d970c026bb19fe1, NAME => 'testtb-testEmptyExportFileSystemState,1,1696194170418.e0ba5644af0c9c365d970c026bb19fe1.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 21:03:01,555 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-01 21:03:01,556 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696194181555"}]},"ts":"9223372036854775807"} 2023-10-01 21:03:01,557 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-01 21:03:01,559 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-01 21:03:01,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 38 msec 2023-10-01 21:03:01,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-01 21:03:01,635 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-01 21:03:01,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-01 21:03:01,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-01 21:03:01,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-01 21:03:01,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-01 21:03:01,670 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 759) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:35787 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4608 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:54370 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:37121 from appattempt_1696194089544_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x67090907-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_964511120_1 at /127.0.0.1:51712 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:46404 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-669172961_17 at /127.0.0.1:51740 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67090907-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:33475 from appattempt_1696194089544_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=924 (was 910) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=121 (was 134), ProcessCount=168 (was 168), AvailableMemoryMB=1351 (was 1291) - AvailableMemoryMB LEAK? - 2023-10-01 21:03:01,670 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 21:03:01,688 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=121, ProcessCount=168, AvailableMemoryMB=1350 2023-10-01 21:03:01,689 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-01 21:03:01,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-01 21:03:01,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:01,693 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-01 21:03:01,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-01 21:03:01,694 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-01 21:03:01,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 21:03:01,696 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:01,696 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:01,696 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f empty. 2023-10-01 21:03:01,696 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3 empty. 2023-10-01 21:03:01,697 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:01,697 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:01,697 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-01 21:03:01,706 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-01 21:03:01,706 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => c71ea2e61ab31a6d790486a1c9541c1f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:03:01,707 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 91e2d3c32fe0c9240c1864bfd115b6a3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp 2023-10-01 21:03:01,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:03:01,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 91e2d3c32fe0c9240c1864bfd115b6a3, disabling compactions & flushes 2023-10-01 21:03:01,721 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:01,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:01,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. after waiting 0 ms 2023-10-01 21:03:01,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:01,721 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:01,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 91e2d3c32fe0c9240c1864bfd115b6a3: 2023-10-01 21:03:01,723 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:03:01,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing c71ea2e61ab31a6d790486a1c9541c1f, disabling compactions & flushes 2023-10-01 21:03:01,724 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:01,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:01,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. after waiting 0 ms 2023-10-01 21:03:01,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:01,724 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:01,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for c71ea2e61ab31a6d790486a1c9541c1f: 2023-10-01 21:03:01,726 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-01 21:03:01,727 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696194181727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194181727"}]},"ts":"1696194181727"} 2023-10-01 21:03:01,727 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696194181727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194181727"}]},"ts":"1696194181727"} 2023-10-01 21:03:01,729 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-01 21:03:01,730 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-01 21:03:01,730 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194181730"}]},"ts":"1696194181730"} 2023-10-01 21:03:01,731 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-01 21:03:01,735 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-01 21:03:01,736 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-01 21:03:01,736 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-01 21:03:01,736 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-01 21:03:01,736 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-01 21:03:01,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c71ea2e61ab31a6d790486a1c9541c1f, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91e2d3c32fe0c9240c1864bfd115b6a3, ASSIGN}] 2023-10-01 21:03:01,739 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c71ea2e61ab31a6d790486a1c9541c1f, ASSIGN 2023-10-01 21:03:01,739 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91e2d3c32fe0c9240c1864bfd115b6a3, ASSIGN 2023-10-01 21:03:01,740 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c71ea2e61ab31a6d790486a1c9541c1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39185,1696194083151; forceNewPlan=false, retain=false 2023-10-01 21:03:01,740 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91e2d3c32fe0c9240c1864bfd115b6a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35853,1696194083102; forceNewPlan=false, retain=false 2023-10-01 21:03:01,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 21:03:01,890 INFO [jenkins-hbase4:37567] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-01 21:03:01,894 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=91e2d3c32fe0c9240c1864bfd115b6a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:01,894 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c71ea2e61ab31a6d790486a1c9541c1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:01,894 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696194181894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194181894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194181894"}]},"ts":"1696194181894"} 2023-10-01 21:03:01,894 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696194181894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194181894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194181894"}]},"ts":"1696194181894"} 2023-10-01 21:03:01,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 91e2d3c32fe0c9240c1864bfd115b6a3, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:03:01,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure c71ea2e61ab31a6d790486a1c9541c1f, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:03:01,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 21:03:02,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:02,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:02,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c71ea2e61ab31a6d790486a1c9541c1f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.', STARTKEY => '', ENDKEY => '1'} 2023-10-01 21:03:02,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91e2d3c32fe0c9240c1864bfd115b6a3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.', STARTKEY => '1', ENDKEY => ''} 2023-10-01 21:03:02,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. service=AccessControlService 2023-10-01 21:03:02,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. service=AccessControlService 2023-10-01 21:03:02,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:03:02,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-01 21:03:02,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:02,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:02,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:03:02,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-01 21:03:02,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:02,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:02,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:02,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:02,052 INFO [StoreOpener-c71ea2e61ab31a6d790486a1c9541c1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:02,052 INFO [StoreOpener-91e2d3c32fe0c9240c1864bfd115b6a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:02,053 DEBUG [StoreOpener-91e2d3c32fe0c9240c1864bfd115b6a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/cf 2023-10-01 21:03:02,053 DEBUG [StoreOpener-c71ea2e61ab31a6d790486a1c9541c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/cf 2023-10-01 21:03:02,053 DEBUG [StoreOpener-c71ea2e61ab31a6d790486a1c9541c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/cf 2023-10-01 21:03:02,053 DEBUG [StoreOpener-91e2d3c32fe0c9240c1864bfd115b6a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/cf 2023-10-01 21:03:02,054 INFO [StoreOpener-91e2d3c32fe0c9240c1864bfd115b6a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91e2d3c32fe0c9240c1864bfd115b6a3 columnFamilyName cf 2023-10-01 21:03:02,054 INFO [StoreOpener-c71ea2e61ab31a6d790486a1c9541c1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c71ea2e61ab31a6d790486a1c9541c1f columnFamilyName cf 2023-10-01 21:03:02,055 INFO [StoreOpener-c71ea2e61ab31a6d790486a1c9541c1f-1] regionserver.HStore(310): Store=c71ea2e61ab31a6d790486a1c9541c1f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:03:02,055 INFO [StoreOpener-91e2d3c32fe0c9240c1864bfd115b6a3-1] regionserver.HStore(310): Store=91e2d3c32fe0c9240c1864bfd115b6a3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-01 21:03:02,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:02,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:02,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:02,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:02,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:02,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:02,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:03:02,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-01 21:03:02,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91e2d3c32fe0c9240c1864bfd115b6a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65883999, jitterRate=-0.01825191080570221}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:03:02,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91e2d3c32fe0c9240c1864bfd115b6a3: 2023-10-01 21:03:02,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c71ea2e61ab31a6d790486a1c9541c1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64665587, jitterRate=-0.03640766441822052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-01 21:03:02,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c71ea2e61ab31a6d790486a1c9541c1f: 2023-10-01 21:03:02,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f., pid=109, masterSystemTime=1696194182047 2023-10-01 21:03:02,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3., pid=108, masterSystemTime=1696194182047 2023-10-01 21:03:02,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:02,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:02,063 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c71ea2e61ab31a6d790486a1c9541c1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:02,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:02,063 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696194182063"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194182063"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194182063"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194182063"}]},"ts":"1696194182063"} 2023-10-01 21:03:02,064 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=91e2d3c32fe0c9240c1864bfd115b6a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,064 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696194182064"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696194182064"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696194182064"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696194182064"}]},"ts":"1696194182064"} 2023-10-01 21:03:02,066 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-01 21:03:02,066 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure c71ea2e61ab31a6d790486a1c9541c1f, server=jenkins-hbase4.apache.org,39185,1696194083151 in 168 msec 2023-10-01 21:03:02,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-10-01 21:03:02,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 91e2d3c32fe0c9240c1864bfd115b6a3, server=jenkins-hbase4.apache.org,35853,1696194083102 in 170 msec 2023-10-01 21:03:02,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c71ea2e61ab31a6d790486a1c9541c1f, ASSIGN in 330 msec 2023-10-01 21:03:02,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-01 21:03:02,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91e2d3c32fe0c9240c1864bfd115b6a3, ASSIGN in 331 msec 2023-10-01 21:03:02,069 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-01 21:03:02,069 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194182069"}]},"ts":"1696194182069"} 2023-10-01 21:03:02,070 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-01 21:03:02,072 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-01 21:03:02,072 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-01 21:03:02,073 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 21:03:02,075 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:02,075 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:02,075 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:02,075 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:02,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 21:03:02,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 21:03:02,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 21:03:02,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-01 21:03:02,078 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 387 msec 2023-10-01 21:03:02,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-01 21:03:02,297 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-01 21:03:02,299 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,299 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:02,301 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:03:02,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 21:03:02,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194182310 (current time:1696194182310). 2023-10-01 21:03:02,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:03:02,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x1979e610 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:03:02,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5526f2d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:03:02,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:03:02,320 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:03:02,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1979e610 to 127.0.0.1:53257 2023-10-01 21:03:02,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:02,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x03cbf4b2 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:03:02,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425152d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:03:02,327 DEBUG [hconnection-0x444d6b3a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:03:02,329 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:03:02,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03cbf4b2 to 127.0.0.1:53257 2023-10-01 21:03:02,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:02,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 21:03:02,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:03:02,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 21:03:02,336 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:03:02,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 21:03:02,338 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 21:03:02,339 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696194782339 2023-10-01 21:03:02,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 21:03:02,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,340 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:03:02,340 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:03:02,341 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 21:03:02,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 21:03:02,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-01 21:03:02,342 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 21:03:02,343 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696194782343 2023-10-01 21:03:02,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,354 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-01 21:03:02,354 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:03:02,355 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-01 21:03:02,355 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-01 21:03:02,356 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,356 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,357 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,357 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,357 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,357 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,357 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,358 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,358 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,358 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 21:03:02,358 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 21:03:02,359 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 21:03:02,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,359 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 21:03:02,359 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:03:02,359 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 21:03:02,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,360 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 21:03:02,360 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 21:03:02,360 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:03:02,359 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:03:02,361 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 21:03:02,361 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 21:03:02,361 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 21:03:02,361 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 21:03:02,360 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 21:03:02,361 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 21:03:02,362 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 21:03:02,362 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 21:03:02,368 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,368 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:03:02,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:03:02,368 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,368 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:03:02,368 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,368 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,369 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:03:02,369 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,369 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:03:02,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:03:02,369 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,369 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:03:02,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:03:02,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 21:03:02,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6946acf0[Count = 1] remaining members to acquire global barrier 2023-10-01 21:03:02,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:03:02,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:03:02,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:03:02,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:03:02,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:03:02,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 21:03:02,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6946acf0[Count = 0] remaining members to acquire global barrier 2023-10-01 21:03:02,372 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-01 21:03:02,372 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,373 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,373 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,373 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,373 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,373 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 21:03:02,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,373 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:03:02,373 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 21:03:02,373 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:02,373 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 21:03:02,374 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. started... 2023-10-01 21:03:02,373 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 21:03:02,373 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,374 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:03:02,374 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:03:02,374 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91e2d3c32fe0c9240c1864bfd115b6a3: 2023-10-01 21:03:02,373 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:03:02,374 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:02,374 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:03:02,374 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:03:02,375 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. started... 2023-10-01 21:03:02,375 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,375 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:03:02,375 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:03:02,375 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c71ea2e61ab31a6d790486a1c9541c1f: 2023-10-01 21:03:02,375 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,375 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:03:02,375 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-01 21:03:02,376 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 21:03:02,376 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:03:02,376 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 21:03:02,385 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. completed. 2023-10-01 21:03:02,385 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:02,385 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:03:02,385 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:03:02,385 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,385 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 21:03:02,386 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:03:02,387 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. completed. 2023-10-01 21:03:02,387 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:02,387 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:03:02,387 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:03:02,387 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,387 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 21:03:02,387 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:03:02,388 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 21:03:02,388 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:03:02,388 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 21:03:02,388 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:03:02,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:03:02,390 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,390 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 21:03:02,390 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:03:02,390 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 21:03:02,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:03:02,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:03:02,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:03:02,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:03:02,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-01 21:03:02,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:03:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:03:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:03:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:03:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:03:02,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39185,1696194083151': 2023-10-01 21:03:02,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-01 21:03:02,398 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-01 21:03:02,398 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:03:02,398 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:03:02,398 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,398 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:03:02,400 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,400 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,400 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,400 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,400 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,400 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,400 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:03:02,401 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,401 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,402 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:03:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,403 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:03:02,403 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,404 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,406 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,406 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,406 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,406 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,406 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,406 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,406 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,406 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,406 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:03:02,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,406 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,406 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,408 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,408 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:03:02,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,408 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,408 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,409 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,409 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,409 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,409 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-01 21:03:02,409 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-01 21:03:02,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,434 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696194182339Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696194182417 (+78 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696194182417Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696194182417Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696194182420 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696194182428 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696194182434 (+6 ms) 2023-10-01 21:03:02,436 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 21:03:02,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 96 msec 2023-10-01 21:03:02,440 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:03:02,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 21:03:02,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:03:02,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39185] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:03:02,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35853] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-01 21:03:02,445 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,446 DEBUG [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:02,446 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-01 21:03:02,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 21:03:02,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696194182453 (current time:1696194182453). 2023-10-01 21:03:02,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-01 21:03:02,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x5743a7d4 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:03:02,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1aeeea7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:03:02,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:03:02,464 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:03:02,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5743a7d4 to 127.0.0.1:53257 2023-10-01 21:03:02,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:02,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(139): Connect 0x68227386 to 127.0.0.1:53257 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-01 21:03:02,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22151451, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-01 21:03:02,471 DEBUG [hconnection-0x4fc5b765-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-01 21:03:02,472 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-01 21:03:02,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68227386 to 127.0.0.1:53257 2023-10-01 21:03:02,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:02,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-01 21:03:02,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-01 21:03:02,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 21:03:02,479 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot, current working dir path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-01 21:03:02,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 21:03:02,481 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 21:03:02,482 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696194782482 2023-10-01 21:03:02,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-01 21:03:02,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,483 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-01 21:03:02,483 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-01 21:03:02,484 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-01 21:03:02,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 21:03:02,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-01 21:03:02,485 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 21:03:02,486 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696194782486 2023-10-01 21:03:02,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,496 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-01 21:03:02,496 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:03:02,497 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-01 21:03:02,497 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-01 21:03:02,498 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,498 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,500 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,500 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,500 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,500 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,500 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,500 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,501 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,501 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 21:03:02,502 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-01 21:03:02,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 21:03:02,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:03:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 21:03:02,503 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 21:03:02,503 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 21:03:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-01 21:03:02,503 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42573,1696194083188' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 21:03:02,503 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:03:02,503 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-01 21:03:02,504 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 21:03:02,505 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-01 21:03:02,505 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 21:03:02,505 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 21:03:02,505 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-01 21:03:02,505 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-01 21:03:02,506 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:03:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:03:02,507 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,507 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:03:02,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:03:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-01 21:03:02,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:03:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:03:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:03:02,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39185,1696194083151' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 21:03:02,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14a709a[Count = 1] remaining members to acquire global barrier 2023-10-01 21:03:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:03:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:03:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:03:02,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:03:02,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:03:02,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35853,1696194083102' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-01 21:03:02,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14a709a[Count = 0] remaining members to acquire global barrier 2023-10-01 21:03:02,511 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-01 21:03:02,511 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,516 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,516 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,516 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,516 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,516 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 21:03:02,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,516 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:03:02,516 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:03:02,516 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 21:03:02,516 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:02,516 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-01 21:03:02,516 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. started... 2023-10-01 21:03:02,517 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-01 21:03:02,516 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 21:03:02,517 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:02,516 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,517 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-01 21:03:02,517 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. started... 2023-10-01 21:03:02,517 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 91e2d3c32fe0c9240c1864bfd115b6a3 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-01 21:03:02,517 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42573,1696194083188' in zk 2023-10-01 21:03:02,517 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-01 21:03:02,517 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c71ea2e61ab31a6d790486a1c9541c1f 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-01 21:03:02,518 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 21:03:02,518 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:03:02,518 DEBUG [member: 'jenkins-hbase4.apache.org,42573,1696194083188' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 21:03:02,535 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231001a820e57923034c18874da497d1ddf740 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001a820e57923034c18874da497d1ddf740 2023-10-01 21:03:02,538 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310010ddd38d26ffe49019254d8e8f8f97b5a to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310010ddd38d26ffe49019254d8e8f8f97b5a 2023-10-01 21:03:02,548 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/.tmp/cf/734600db161449f5b74fea281c4d3204 2023-10-01 21:03:02,551 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/.tmp/cf/71bafa33c92a437c82c01d7c38866000 2023-10-01 21:03:02,553 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/.tmp/cf/734600db161449f5b74fea281c4d3204 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/cf/734600db161449f5b74fea281c4d3204 2023-10-01 21:03:02,555 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/.tmp/cf/71bafa33c92a437c82c01d7c38866000 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/cf/71bafa33c92a437c82c01d7c38866000 2023-10-01 21:03:02,557 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/cf/734600db161449f5b74fea281c4d3204, entries=2, sequenceid=6, filesize=5.2 K 2023-10-01 21:03:02,558 INFO [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c71ea2e61ab31a6d790486a1c9541c1f in 41ms, sequenceid=6, compaction requested=false 2023-10-01 21:03:02,558 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-01 21:03:02,558 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c71ea2e61ab31a6d790486a1c9541c1f: 2023-10-01 21:03:02,558 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,558 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:03:02,558 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/cf/734600db161449f5b74fea281c4d3204] hfiles 2023-10-01 21:03:02,559 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/cf/734600db161449f5b74fea281c4d3204 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,559 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/cf/71bafa33c92a437c82c01d7c38866000, entries=48, sequenceid=6, filesize=13.5 K 2023-10-01 21:03:02,560 INFO [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 91e2d3c32fe0c9240c1864bfd115b6a3 in 43ms, sequenceid=6, compaction requested=false 2023-10-01 21:03:02,561 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91e2d3c32fe0c9240c1864bfd115b6a3: 2023-10-01 21:03:02,562 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,562 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-01 21:03:02,562 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/cf/71bafa33c92a437c82c01d7c38866000] hfiles 2023-10-01 21:03:02,562 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/cf/71bafa33c92a437c82c01d7c38866000 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,566 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. completed. 2023-10-01 21:03:02,566 DEBUG [rs(jenkins-hbase4.apache.org,39185,1696194083151)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:02,566 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:03:02,566 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:03:02,567 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,567 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 21:03:02,567 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39185,1696194083151' in zk 2023-10-01 21:03:02,568 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,568 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 21:03:02,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,568 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:03:02,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:03:02,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:03:02,568 DEBUG [member: 'jenkins-hbase4.apache.org,39185,1696194083151' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 21:03:02,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:03:02,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:03:02,571 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. completed. 2023-10-01 21:03:02,571 DEBUG [rs(jenkins-hbase4.apache.org,35853,1696194083102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:02,571 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-01 21:03:02,571 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-01 21:03:02,571 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,571 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-01 21:03:02,571 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35853,1696194083102' in zk 2023-10-01 21:03:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,572 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,572 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-01 21:03:02,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,572 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:03:02,572 DEBUG [member: 'jenkins-hbase4.apache.org,35853,1696194083102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-01 21:03:02,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:03:02,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39185,1696194083151': 2023-10-01 21:03:02,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39185,1696194083151' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-01 21:03:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:03:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:03:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:03:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:03:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:03:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35853,1696194083102': 2023-10-01 21:03:02,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35853,1696194083102' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-01 21:03:02,578 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-01 21:03:02,578 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-01 21:03:02,578 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-01 21:03:02,578 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,578 INFO [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-01 21:03:02,580 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,580 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,580 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,580 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-01 21:03:02,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,580 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-01 21:03:02,580 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,581 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,581 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-01 21:03:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,581 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,582 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-01 21:03:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,583 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:03:02,583 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-01 21:03:02,584 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 21:03:02,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-01 21:03:02,584 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,584 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-01 21:03:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-01 21:03:02,586 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,587 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-01 21:03:02,586 DEBUG [(jenkins-hbase4.apache.org,37567,1696194081862)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-01 21:03:02,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,586 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-01 21:03:02,588 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:02,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-01 21:03:02,588 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,588 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:02,588 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:02,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310010ddd38d26ffe49019254d8e8f8f97b5a, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001a820e57923034c18874da497d1ddf740] mob files 2023-10-01 21:03:02,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-01 21:03:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-01 21:03:02,588 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310010ddd38d26ffe49019254d8e8f8f97b5a 2023-10-01 21:03:02,589 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001a820e57923034c18874da497d1ddf740 2023-10-01 21:03:02,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-01 21:03:02,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,611 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696194182482Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696194182596 (+114 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696194182596Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696194182596Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696194182599 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696194182605 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696194182611 (+6 ms) 2023-10-01 21:03:02,614 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-01 21:03:02,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 131 msec 2023-10-01 21:03:02,784 DEBUG [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-01 21:03:02,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-01 21:03:02,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-01 21:03:02,786 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194182786 2023-10-01 21:03:02,786 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33955, tgtDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194182786, rawTgtDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194182786, srcFsUri=hdfs://localhost:33955, srcDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:03:02,808 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89 2023-10-01 21:03:02,808 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2142826059_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194182786, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194182786/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,808 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33955, inputRoot=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89, snapshotDir=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-01 21:03:02,815 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194182786/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:02,833 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:02,833 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:02,834 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:02,834 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:03,704 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-2495031096975336607.jar 2023-10-01 21:03:03,705 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:03,705 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:03,771 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/hadoop-4511231558471488019.jar 2023-10-01 21:03:03,772 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:03,772 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:03,773 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:03,773 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:03,773 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:03,774 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-01 21:03:03,774 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-01 21:03:03,774 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-01 21:03:03,775 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-01 21:03:03,775 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-01 21:03:03,775 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-01 21:03:03,776 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-01 21:03:03,776 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-01 21:03:03,776 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-01 21:03:03,777 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-01 21:03:03,777 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-01 21:03:03,778 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:03:03,778 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:03:03,779 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:03:03,779 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:03:03,779 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-01 21:03:03,779 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:03:03,780 DEBUG [Listener at jenkins-hbase4.apache.org/42645] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-01 21:03:04,173 WARN [Listener at jenkins-hbase4.apache.org/42645] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-01 21:03:04,175 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-01 21:03:04,176 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-01 21:03:05,694 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:03:05,694 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-01 21:03:05,696 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0006_000001 (auth:SIMPLE) 2023-10-01 21:03:05,985 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0007_000001 (auth:SIMPLE) 2023-10-01 21:03:06,968 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 21:03:09,667 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0007_000001 (auth:SIMPLE) 2023-10-01 21:03:11,873 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0007_000001 (auth:SIMPLE) 2023-10-01 21:03:14,427 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0007_000001 (auth:SIMPLE) 2023-10-01 21:03:16,329 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-01 21:03:16,329 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-01 21:03:16,340 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,340 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-01 21:03:16,340 INFO [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-01 21:03:16,340 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,341 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-01 21:03:16,341 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-01 21:03:16,341 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-669172961_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194182786/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194182786/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,341 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194182786/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-01 21:03:16,341 DEBUG [Listener at jenkins-hbase4.apache.org/42645] snapshot.TestExportSnapshot(367): hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/export-test/export-1696194182786/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-01 21:03:16,347 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 21:03:16,351 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194196351"}]},"ts":"1696194196351"} 2023-10-01 21:03:16,352 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-01 21:03:16,353 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-01 21:03:16,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c71ea2e61ab31a6d790486a1c9541c1f, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91e2d3c32fe0c9240c1864bfd115b6a3, UNASSIGN}] 2023-10-01 21:03:16,354 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c71ea2e61ab31a6d790486a1c9541c1f, UNASSIGN 2023-10-01 21:03:16,355 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91e2d3c32fe0c9240c1864bfd115b6a3, UNASSIGN 2023-10-01 21:03:16,356 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c71ea2e61ab31a6d790486a1c9541c1f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:16,356 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=91e2d3c32fe0c9240c1864bfd115b6a3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:16,356 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696194196356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194196356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194196356"}]},"ts":"1696194196356"} 2023-10-01 21:03:16,356 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696194196356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696194196356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696194196356"}]},"ts":"1696194196356"} 2023-10-01 21:03:16,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 91e2d3c32fe0c9240c1864bfd115b6a3, server=jenkins-hbase4.apache.org,35853,1696194083102}] 2023-10-01 21:03:16,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure c71ea2e61ab31a6d790486a1c9541c1f, server=jenkins-hbase4.apache.org,39185,1696194083151}] 2023-10-01 21:03:16,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 21:03:16,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:16,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91e2d3c32fe0c9240c1864bfd115b6a3, disabling compactions & flushes 2023-10-01 21:03:16,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:16,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:16,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. after waiting 0 ms 2023-10-01 21:03:16,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:16,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:16,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c71ea2e61ab31a6d790486a1c9541c1f, disabling compactions & flushes 2023-10-01 21:03:16,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:16,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:16,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. after waiting 0 ms 2023-10-01 21:03:16,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:16,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:03:16,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:16,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:03:16,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3. 2023-10-01 21:03:16,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91e2d3c32fe0c9240c1864bfd115b6a3: 2023-10-01 21:03:16,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:16,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f. 2023-10-01 21:03:16,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c71ea2e61ab31a6d790486a1c9541c1f: 2023-10-01 21:03:16,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:16,525 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=91e2d3c32fe0c9240c1864bfd115b6a3, regionState=CLOSED 2023-10-01 21:03:16,525 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696194196525"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194196525"}]},"ts":"1696194196525"} 2023-10-01 21:03:16,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:16,525 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c71ea2e61ab31a6d790486a1c9541c1f, regionState=CLOSED 2023-10-01 21:03:16,525 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696194196525"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696194196525"}]},"ts":"1696194196525"} 2023-10-01 21:03:16,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-10-01 21:03:16,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 91e2d3c32fe0c9240c1864bfd115b6a3, server=jenkins-hbase4.apache.org,35853,1696194083102 in 169 msec 2023-10-01 21:03:16,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-10-01 21:03:16,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure c71ea2e61ab31a6d790486a1c9541c1f, server=jenkins-hbase4.apache.org,39185,1696194083151 in 169 msec 2023-10-01 21:03:16,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91e2d3c32fe0c9240c1864bfd115b6a3, UNASSIGN in 174 msec 2023-10-01 21:03:16,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-10-01 21:03:16,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c71ea2e61ab31a6d790486a1c9541c1f, UNASSIGN in 174 msec 2023-10-01 21:03:16,530 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696194196530"}]},"ts":"1696194196530"} 2023-10-01 21:03:16,531 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-01 21:03:16,533 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-01 21:03:16,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 186 msec 2023-10-01 21:03:16,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-01 21:03:16,652 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-01 21:03:16,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,655 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,656 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,657 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39185] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,660 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:16,660 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:16,661 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,661 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,661 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,661 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,661 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 21:03:16,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 21:03:16,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 21:03:16,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-01 21:03:16,662 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/recovered.edits] 2023-10-01 21:03:16,662 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/cf, FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/recovered.edits] 2023-10-01 21:03:16,663 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,663 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:16,663 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,663 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:16,663 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,663 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:16,663 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,663 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-01 21:03:16,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-01 21:03:16,666 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/cf/734600db161449f5b74fea281c4d3204 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/cf/734600db161449f5b74fea281c4d3204 2023-10-01 21:03:16,666 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/cf/71bafa33c92a437c82c01d7c38866000 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/cf/71bafa33c92a437c82c01d7c38866000 2023-10-01 21:03:16,669 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f/recovered.edits/9.seqid 2023-10-01 21:03:16,669 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/recovered.edits/9.seqid to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3/recovered.edits/9.seqid 2023-10-01 21:03:16,670 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c71ea2e61ab31a6d790486a1c9541c1f 2023-10-01 21:03:16,670 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91e2d3c32fe0c9240c1864bfd115b6a3 2023-10-01 21:03:16,670 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-01 21:03:16,670 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-01 21:03:16,671 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-01 21:03:16,674 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310010ddd38d26ffe49019254d8e8f8f97b5a to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310010ddd38d26ffe49019254d8e8f8f97b5a 2023-10-01 21:03:16,675 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001a820e57923034c18874da497d1ddf740 to hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231001a820e57923034c18874da497d1ddf740 2023-10-01 21:03:16,676 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-01 21:03:16,677 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,679 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-01 21:03:16,681 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-01 21:03:16,682 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,682 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-01 21:03:16,682 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194196682"}]},"ts":"9223372036854775807"} 2023-10-01 21:03:16,682 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696194196682"}]},"ts":"9223372036854775807"} 2023-10-01 21:03:16,683 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-01 21:03:16,684 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c71ea2e61ab31a6d790486a1c9541c1f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696194181690.c71ea2e61ab31a6d790486a1c9541c1f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 91e2d3c32fe0c9240c1864bfd115b6a3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696194181690.91e2d3c32fe0c9240c1864bfd115b6a3.', STARTKEY => '1', ENDKEY => ''}] 2023-10-01 21:03:16,684 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-01 21:03:16,684 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696194196684"}]},"ts":"9223372036854775807"} 2023-10-01 21:03:16,686 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-01 21:03:16,688 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,689 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-10-01 21:03:16,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-01 21:03:16,765 INFO [Listener at jenkins-hbase4.apache.org/42645] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-01 21:03:16,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-01 21:03:16,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-01 21:03:16,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37567] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-01 21:03:16,799 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 765), OpenFileDescriptor=905 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=140 (was 121) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1177 (was 1350) 2023-10-01 21:03:16,799 WARN [Listener at jenkins-hbase4.apache.org/42645] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-10-01 21:03:16,799 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-01 21:03:16,809 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 21:03:20,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696194089544_0007_000001 (auth:SIMPLE) 2023-10-01 21:03:22,086 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-01 21:03:30,935 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 21:03:45,050 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 21:03:45,050 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 21:03:45,157 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-01 21:03:45,165 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-01 21:03:45,166 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 21:03:45,176 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-01 21:03:45,280 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-01 21:03:45,280 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-01 21:03:45,280 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-01 21:03:45,280 INFO [Listener at jenkins-hbase4.apache.org/42645] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-01 21:03:45,280 DEBUG [Listener at jenkins-hbase4.apache.org/42645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51038fe2 to 127.0.0.1:53257 2023-10-01 21:03:45,280 DEBUG [Listener at jenkins-hbase4.apache.org/42645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:45,281 DEBUG [Listener at jenkins-hbase4.apache.org/42645] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-01 21:03:45,281 DEBUG [Listener at jenkins-hbase4.apache.org/42645] util.JVMClusterUtil(257): Found active master hash=157136909, stopped=false 2023-10-01 21:03:45,281 DEBUG [Listener at jenkins-hbase4.apache.org/42645] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:45,281 DEBUG [Listener at jenkins-hbase4.apache.org/42645] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-01 21:03:45,281 INFO [Listener at jenkins-hbase4.apache.org/42645] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37567,1696194081862 2023-10-01 21:03:45,282 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 21:03:45,282 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 21:03:45,282 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 21:03:45,282 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-01 21:03:45,282 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:03:45,282 INFO [Listener at jenkins-hbase4.apache.org/42645] procedure2.ProcedureExecutor(628): Stopping 2023-10-01 21:03:45,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 21:03:45,283 DEBUG [Listener at jenkins-hbase4.apache.org/42645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0face903 to 127.0.0.1:53257 2023-10-01 21:03:45,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 21:03:45,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 21:03:45,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-01 21:03:45,283 DEBUG [Listener at jenkins-hbase4.apache.org/42645] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:45,283 INFO [Listener at jenkins-hbase4.apache.org/42645] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35853,1696194083102' ***** 2023-10-01 21:03:45,283 DEBUG [Listener at jenkins-hbase4.apache.org/42645] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:45,284 INFO [Listener at jenkins-hbase4.apache.org/42645] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 21:03:45,284 INFO [Listener at jenkins-hbase4.apache.org/42645] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39185,1696194083151' ***** 2023-10-01 21:03:45,284 DEBUG [Listener at jenkins-hbase4.apache.org/42645] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:45,284 INFO [Listener at jenkins-hbase4.apache.org/42645] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 21:03:45,284 INFO [Listener at jenkins-hbase4.apache.org/42645] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42573,1696194083188' ***** 2023-10-01 21:03:45,284 INFO [RS:0;jenkins-hbase4:35853] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 21:03:45,284 DEBUG [Listener at jenkins-hbase4.apache.org/42645] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:45,284 INFO [RS:1;jenkins-hbase4:39185] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 21:03:45,284 INFO [RS:0;jenkins-hbase4:35853] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 21:03:45,284 INFO [RS:1;jenkins-hbase4:39185] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 21:03:45,284 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 21:03:45,284 INFO [RS:1;jenkins-hbase4:39185] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 21:03:45,284 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 21:03:45,284 INFO [RS:0;jenkins-hbase4:35853] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 21:03:45,284 INFO [Listener at jenkins-hbase4.apache.org/42645] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-01 21:03:45,284 INFO [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:45,284 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(3305): Received CLOSE for ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:03:45,285 DEBUG [RS:0;jenkins-hbase4:35853] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19f992f5 to 127.0.0.1:53257 2023-10-01 21:03:45,285 INFO [RS:2;jenkins-hbase4:42573] regionserver.HeapMemoryManager(220): Stopping 2023-10-01 21:03:45,285 DEBUG [RS:0;jenkins-hbase4:35853] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:45,285 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-01 21:03:45,285 INFO [RS:2;jenkins-hbase4:42573] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-01 21:03:45,285 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:45,285 INFO [RS:2;jenkins-hbase4:42573] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-01 21:03:45,285 DEBUG [RS:1;jenkins-hbase4:39185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b405130 to 127.0.0.1:53257 2023-10-01 21:03:45,285 DEBUG [RS:1;jenkins-hbase4:39185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:45,285 INFO [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(3305): Received CLOSE for d7de2271be8d0199690d4632c668f82c 2023-10-01 21:03:45,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec9b72c29d03ee09c3a25709c05e4bee, disabling compactions & flushes 2023-10-01 21:03:45,287 INFO [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:45,287 INFO [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35853,1696194083102; all regions closed. 2023-10-01 21:03:45,287 INFO [RS:1;jenkins-hbase4:39185] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 21:03:45,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d7de2271be8d0199690d4632c668f82c, disabling compactions & flushes 2023-10-01 21:03:45,287 DEBUG [RS:2;jenkins-hbase4:42573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c967409 to 127.0.0.1:53257 2023-10-01 21:03:45,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:03:45,288 DEBUG [RS:2;jenkins-hbase4:42573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:45,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:03:45,289 INFO [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-01 21:03:45,288 INFO [RS:1;jenkins-hbase4:39185] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 21:03:45,289 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1478): Online Regions={d7de2271be8d0199690d4632c668f82c=hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c.} 2023-10-01 21:03:45,289 INFO [RS:1;jenkins-hbase4:39185] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 21:03:45,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:03:45,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:03:45,289 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-01 21:03:45,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. after waiting 0 ms 2023-10-01 21:03:45,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. after waiting 0 ms 2023-10-01 21:03:45,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:03:45,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:03:45,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d7de2271be8d0199690d4632c668f82c 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-01 21:03:45,289 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-01 21:03:45,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ec9b72c29d03ee09c3a25709c05e4bee 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-01 21:03:45,290 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-01 21:03:45,290 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, ec9b72c29d03ee09c3a25709c05e4bee=hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee.} 2023-10-01 21:03:45,290 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-01 21:03:45,290 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-01 21:03:45,290 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-01 21:03:45,290 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-01 21:03:45,290 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-01 21:03:45,290 DEBUG [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1504): Waiting on 1588230740, ec9b72c29d03ee09c3a25709c05e4bee 2023-10-01 21:03:45,290 DEBUG [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1504): Waiting on d7de2271be8d0199690d4632c668f82c 2023-10-01 21:03:45,296 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 21:03:45,296 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 21:03:45,306 DEBUG [RS:0;jenkins-hbase4:35853] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/oldWALs 2023-10-01 21:03:45,306 INFO [RS:0;jenkins-hbase4:35853] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35853%2C1696194083102:(num 1696194084847) 2023-10-01 21:03:45,306 DEBUG [RS:0;jenkins-hbase4:35853] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:45,306 INFO [RS:0;jenkins-hbase4:35853] regionserver.LeaseManager(133): Closed leases 2023-10-01 21:03:45,312 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-01 21:03:45,312 INFO [RS:0;jenkins-hbase4:35853] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-01 21:03:45,312 INFO [RS:0;jenkins-hbase4:35853] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 21:03:45,312 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 21:03:45,312 INFO [RS:0;jenkins-hbase4:35853] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 21:03:45,312 INFO [RS:0;jenkins-hbase4:35853] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 21:03:45,313 INFO [RS:0;jenkins-hbase4:35853] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35853 2023-10-01 21:03:45,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c/.tmp/info/86199ae5b37d41e0a80aaa12273001f5 2023-10-01 21:03:45,326 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/.tmp/info/85bd2656958d4d5bb9676412feb6420d 2023-10-01 21:03:45,326 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:45,326 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:45,326 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 21:03:45,326 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 21:03:45,326 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35853,1696194083102 2023-10-01 21:03:45,326 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 21:03:45,326 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 21:03:45,333 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35853,1696194083102] 2023-10-01 21:03:45,334 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35853,1696194083102; numProcessing=1 2023-10-01 21:03:45,337 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35853,1696194083102 already deleted, retry=false 2023-10-01 21:03:45,337 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35853,1696194083102 expired; onlineServers=2 2023-10-01 21:03:45,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee/.tmp/l/e855e41586f243a8a591344a2fab9c5d 2023-10-01 21:03:45,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c/.tmp/info/86199ae5b37d41e0a80aaa12273001f5 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c/info/86199ae5b37d41e0a80aaa12273001f5 2023-10-01 21:03:45,339 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85bd2656958d4d5bb9676412feb6420d 2023-10-01 21:03:45,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e855e41586f243a8a591344a2fab9c5d 2023-10-01 21:03:45,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee/.tmp/l/e855e41586f243a8a591344a2fab9c5d as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee/l/e855e41586f243a8a591344a2fab9c5d 2023-10-01 21:03:45,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c/info/86199ae5b37d41e0a80aaa12273001f5, entries=2, sequenceid=6, filesize=4.8 K 2023-10-01 21:03:45,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d7de2271be8d0199690d4632c668f82c in 56ms, sequenceid=6, compaction requested=false 2023-10-01 21:03:45,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e855e41586f243a8a591344a2fab9c5d 2023-10-01 21:03:45,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee/l/e855e41586f243a8a591344a2fab9c5d, entries=7, sequenceid=18, filesize=5.2 K 2023-10-01 21:03:45,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ec9b72c29d03ee09c3a25709c05e4bee in 64ms, sequenceid=18, compaction requested=false 2023-10-01 21:03:45,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/namespace/d7de2271be8d0199690d4632c668f82c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-01 21:03:45,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:45,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:03:45,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d7de2271be8d0199690d4632c668f82c: 2023-10-01 21:03:45,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696194085294.d7de2271be8d0199690d4632c668f82c. 2023-10-01 21:03:45,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/.tmp/rep_barrier/fe7d31fc11684f7b8742d672b247b24e 2023-10-01 21:03:45,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/acl/ec9b72c29d03ee09c3a25709c05e4bee/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-01 21:03:45,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:45,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:03:45,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec9b72c29d03ee09c3a25709c05e4bee: 2023-10-01 21:03:45,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696194086038.ec9b72c29d03ee09c3a25709c05e4bee. 2023-10-01 21:03:45,366 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe7d31fc11684f7b8742d672b247b24e 2023-10-01 21:03:45,376 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/.tmp/table/bc41e4504619434f9a17d8be4f52d619 2023-10-01 21:03:45,379 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc41e4504619434f9a17d8be4f52d619 2023-10-01 21:03:45,380 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/.tmp/info/85bd2656958d4d5bb9676412feb6420d as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/info/85bd2656958d4d5bb9676412feb6420d 2023-10-01 21:03:45,384 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85bd2656958d4d5bb9676412feb6420d 2023-10-01 21:03:45,384 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/info/85bd2656958d4d5bb9676412feb6420d, entries=48, sequenceid=131, filesize=10.3 K 2023-10-01 21:03:45,384 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/.tmp/rep_barrier/fe7d31fc11684f7b8742d672b247b24e as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/rep_barrier/fe7d31fc11684f7b8742d672b247b24e 2023-10-01 21:03:45,389 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe7d31fc11684f7b8742d672b247b24e 2023-10-01 21:03:45,389 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/rep_barrier/fe7d31fc11684f7b8742d672b247b24e, entries=13, sequenceid=131, filesize=6.4 K 2023-10-01 21:03:45,390 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/.tmp/table/bc41e4504619434f9a17d8be4f52d619 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/table/bc41e4504619434f9a17d8be4f52d619 2023-10-01 21:03:45,395 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc41e4504619434f9a17d8be4f52d619 2023-10-01 21:03:45,395 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/table/bc41e4504619434f9a17d8be4f52d619, entries=24, sequenceid=131, filesize=6.9 K 2023-10-01 21:03:45,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 106ms, sequenceid=131, compaction requested=false 2023-10-01 21:03:45,406 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-01 21:03:45,406 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-01 21:03:45,406 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-01 21:03:45,407 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-01 21:03:45,407 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-01 21:03:45,407 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-01 21:03:45,434 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 21:03:45,434 INFO [RS:0;jenkins-hbase4:35853] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35853,1696194083102; zookeeper connection closed. 2023-10-01 21:03:45,434 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:35853-0x10103cae84f0001, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 21:03:45,435 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@653fc5ef] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@653fc5ef 2023-10-01 21:03:45,490 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39185,1696194083151; all regions closed. 2023-10-01 21:03:45,490 INFO [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42573,1696194083188; all regions closed. 2023-10-01 21:03:45,497 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/WALs/jenkins-hbase4.apache.org,42573,1696194083188/jenkins-hbase4.apache.org%2C42573%2C1696194083188.1696194084847 not finished, retry = 0 2023-10-01 21:03:45,499 DEBUG [RS:1;jenkins-hbase4:39185] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/oldWALs 2023-10-01 21:03:45,499 INFO [RS:1;jenkins-hbase4:39185] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39185%2C1696194083151.meta:.meta(num 1696194084978) 2023-10-01 21:03:45,505 DEBUG [RS:1;jenkins-hbase4:39185] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/oldWALs 2023-10-01 21:03:45,505 INFO [RS:1;jenkins-hbase4:39185] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39185%2C1696194083151:(num 1696194084847) 2023-10-01 21:03:45,505 DEBUG [RS:1;jenkins-hbase4:39185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:45,505 INFO [RS:1;jenkins-hbase4:39185] regionserver.LeaseManager(133): Closed leases 2023-10-01 21:03:45,505 INFO [RS:1;jenkins-hbase4:39185] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-01 21:03:45,506 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 21:03:45,506 INFO [RS:1;jenkins-hbase4:39185] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39185 2023-10-01 21:03:45,508 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:45,508 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39185,1696194083151 2023-10-01 21:03:45,508 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 21:03:45,509 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39185,1696194083151] 2023-10-01 21:03:45,509 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39185,1696194083151; numProcessing=2 2023-10-01 21:03:45,510 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39185,1696194083151 already deleted, retry=false 2023-10-01 21:03:45,510 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39185,1696194083151 expired; onlineServers=1 2023-10-01 21:03:45,599 DEBUG [RS:2;jenkins-hbase4:42573] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/oldWALs 2023-10-01 21:03:45,599 INFO [RS:2;jenkins-hbase4:42573] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42573%2C1696194083188:(num 1696194084847) 2023-10-01 21:03:45,599 DEBUG [RS:2;jenkins-hbase4:42573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:45,599 INFO [RS:2;jenkins-hbase4:42573] regionserver.LeaseManager(133): Closed leases 2023-10-01 21:03:45,599 INFO [RS:2;jenkins-hbase4:42573] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-01 21:03:45,599 INFO [RS:2;jenkins-hbase4:42573] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-01 21:03:45,599 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 21:03:45,599 INFO [RS:2;jenkins-hbase4:42573] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-01 21:03:45,600 INFO [RS:2;jenkins-hbase4:42573] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-01 21:03:45,600 INFO [RS:2;jenkins-hbase4:42573] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42573 2023-10-01 21:03:45,603 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42573,1696194083188 2023-10-01 21:03:45,603 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-01 21:03:45,604 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42573,1696194083188] 2023-10-01 21:03:45,604 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42573,1696194083188; numProcessing=3 2023-10-01 21:03:45,605 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42573,1696194083188 already deleted, retry=false 2023-10-01 21:03:45,605 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42573,1696194083188 expired; onlineServers=0 2023-10-01 21:03:45,605 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37567,1696194081862' ***** 2023-10-01 21:03:45,605 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-01 21:03:45,605 DEBUG [M:0;jenkins-hbase4:37567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4860b236, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-01 21:03:45,605 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37567,1696194081862 2023-10-01 21:03:45,605 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37567,1696194081862; all regions closed. 2023-10-01 21:03:45,605 DEBUG [M:0;jenkins-hbase4:37567] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-01 21:03:45,605 DEBUG [M:0;jenkins-hbase4:37567] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-01 21:03:45,605 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-01 21:03:45,605 DEBUG [M:0;jenkins-hbase4:37567] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-01 21:03:45,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696194084458] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696194084458,5,FailOnTimeoutGroup] 2023-10-01 21:03:45,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696194084461] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696194084461,5,FailOnTimeoutGroup] 2023-10-01 21:03:45,605 INFO [M:0;jenkins-hbase4:37567] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-01 21:03:45,606 INFO [M:0;jenkins-hbase4:37567] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-01 21:03:45,606 INFO [M:0;jenkins-hbase4:37567] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-01 21:03:45,606 DEBUG [M:0;jenkins-hbase4:37567] master.HMaster(1512): Stopping service threads 2023-10-01 21:03:45,606 INFO [M:0;jenkins-hbase4:37567] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-01 21:03:45,606 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-01 21:03:45,606 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-01 21:03:45,606 ERROR [M:0;jenkins-hbase4:37567] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-01 21:03:45,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-01 21:03:45,607 INFO [M:0;jenkins-hbase4:37567] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-01 21:03:45,607 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-01 21:03:45,607 DEBUG [M:0;jenkins-hbase4:37567] zookeeper.ZKUtil(398): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-01 21:03:45,607 WARN [M:0;jenkins-hbase4:37567] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-01 21:03:45,607 INFO [M:0;jenkins-hbase4:37567] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-01 21:03:45,607 INFO [M:0;jenkins-hbase4:37567] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-01 21:03:45,608 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-01 21:03:45,608 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 21:03:45,608 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 21:03:45,608 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-01 21:03:45,608 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 21:03:45,608 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.90 KB heapSize=452.14 KB 2023-10-01 21:03:45,609 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 21:03:45,609 INFO [RS:1;jenkins-hbase4:39185] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39185,1696194083151; zookeeper connection closed. 2023-10-01 21:03:45,609 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:39185-0x10103cae84f0002, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 21:03:45,609 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@407d48a1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@407d48a1 2023-10-01 21:03:45,620 INFO [M:0;jenkins-hbase4:37567] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.90 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bb92a6513c464245b724545040b2ba32 2023-10-01 21:03:45,624 INFO [M:0;jenkins-hbase4:37567] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb92a6513c464245b724545040b2ba32 2023-10-01 21:03:45,624 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bb92a6513c464245b724545040b2ba32 as hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bb92a6513c464245b724545040b2ba32 2023-10-01 21:03:45,628 INFO [M:0;jenkins-hbase4:37567] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb92a6513c464245b724545040b2ba32 2023-10-01 21:03:45,628 INFO [M:0;jenkins-hbase4:37567] regionserver.HStore(1080): Added hdfs://localhost:33955/user/jenkins/test-data/13b44049-400e-9439-9851-ad0af54d3f89/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bb92a6513c464245b724545040b2ba32, entries=119, sequenceid=899, filesize=28.7 K 2023-10-01 21:03:45,629 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegion(2948): Finished flush of dataSize ~375.90 KB/384921, heapSize ~452.13 KB/462976, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-10-01 21:03:45,630 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-01 21:03:45,630 DEBUG [M:0;jenkins-hbase4:37567] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-01 21:03:45,633 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-01 21:03:45,633 INFO [M:0;jenkins-hbase4:37567] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-01 21:03:45,634 INFO [M:0;jenkins-hbase4:37567] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37567 2023-10-01 21:03:45,636 DEBUG [M:0;jenkins-hbase4:37567] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37567,1696194081862 already deleted, retry=false 2023-10-01 21:03:45,709 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 21:03:45,709 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): regionserver:42573-0x10103cae84f0003, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 21:03:45,709 INFO [RS:2;jenkins-hbase4:42573] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42573,1696194083188; zookeeper connection closed. 2023-10-01 21:03:45,709 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@50f873bd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@50f873bd 2023-10-01 21:03:45,710 INFO [Listener at jenkins-hbase4.apache.org/42645] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-01 21:03:45,809 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 21:03:45,809 INFO [M:0;jenkins-hbase4:37567] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37567,1696194081862; zookeeper connection closed. 2023-10-01 21:03:45,809 DEBUG [Listener at localhost/35805-EventThread] zookeeper.ZKWatcher(600): master:37567-0x10103cae84f0000, quorum=127.0.0.1:53257, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-01 21:03:45,811 WARN [Listener at jenkins-hbase4.apache.org/42645] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 21:03:45,813 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 21:03:45,916 WARN [BP-132149635-172.31.14.131-1696194078224 heartbeating to localhost/127.0.0.1:33955] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 21:03:45,916 WARN [BP-132149635-172.31.14.131-1696194078224 heartbeating to localhost/127.0.0.1:33955] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-132149635-172.31.14.131-1696194078224 (Datanode Uuid 4b8192ed-0a19-48e1-aa82-f56e3505babc) service to localhost/127.0.0.1:33955 2023-10-01 21:03:45,918 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data5/current/BP-132149635-172.31.14.131-1696194078224] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 21:03:45,918 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data6/current/BP-132149635-172.31.14.131-1696194078224] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 21:03:45,919 WARN [Listener at jenkins-hbase4.apache.org/42645] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 21:03:45,921 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 21:03:46,024 WARN [BP-132149635-172.31.14.131-1696194078224 heartbeating to localhost/127.0.0.1:33955] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 21:03:46,024 WARN [BP-132149635-172.31.14.131-1696194078224 heartbeating to localhost/127.0.0.1:33955] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-132149635-172.31.14.131-1696194078224 (Datanode Uuid 74b202e7-f90f-4078-a7d6-1452e3860bc9) service to localhost/127.0.0.1:33955 2023-10-01 21:03:46,025 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data3/current/BP-132149635-172.31.14.131-1696194078224] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 21:03:46,025 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data4/current/BP-132149635-172.31.14.131-1696194078224] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 21:03:46,026 WARN [Listener at jenkins-hbase4.apache.org/42645] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-01 21:03:46,028 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 21:03:46,131 WARN [BP-132149635-172.31.14.131-1696194078224 heartbeating to localhost/127.0.0.1:33955] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-01 21:03:46,131 WARN [BP-132149635-172.31.14.131-1696194078224 heartbeating to localhost/127.0.0.1:33955] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-132149635-172.31.14.131-1696194078224 (Datanode Uuid b2327866-66c0-4ea5-8cb3-b32e0cbe6400) service to localhost/127.0.0.1:33955 2023-10-01 21:03:46,132 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data1/current/BP-132149635-172.31.14.131-1696194078224] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 21:03:46,132 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/23ae6b4c-2a25-41ba-d942-22c9ad142777/cluster_c4be9040-4284-617f-23f8-a7490df7035c/dfs/data/data2/current/BP-132149635-172.31.14.131-1696194078224] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-01 21:03:46,153 INFO [Listener at jenkins-hbase4.apache.org/42645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-01 21:03:46,279 INFO [Listener at jenkins-hbase4.apache.org/42645] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-01 21:03:46,370 INFO [Listener at jenkins-hbase4.apache.org/42645] hbase.HBaseTestingUtility(1293): Minicluster is down