2023-10-04 00:00:20,519 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-04 00:00:20,729 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725 2023-10-04 00:00:20,730 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-04 00:00:20,730 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-04 00:00:20,772 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-04 00:00:20,980 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-04 00:00:20,980 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe, deleteOnExit=true 2023-10-04 00:00:20,980 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-04 00:00:20,981 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/test.cache.data in system properties and HBase conf 2023-10-04 00:00:20,981 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop.tmp.dir in system properties and HBase conf 2023-10-04 00:00:20,981 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop.log.dir in system properties and HBase conf 2023-10-04 00:00:20,982 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-04 00:00:20,982 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-04 00:00:20,983 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-04 00:00:21,261 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-04 00:00:21,266 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-04 00:00:21,266 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-04 00:00:21,267 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-04 00:00:21,267 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 00:00:21,267 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-04 00:00:21,268 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-04 00:00:21,268 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 00:00:21,268 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 00:00:21,269 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-04 00:00:21,269 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/nfs.dump.dir in system properties and HBase conf 2023-10-04 00:00:21,269 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/java.io.tmpdir in system properties and HBase conf 2023-10-04 00:00:21,270 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 00:00:21,270 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-04 00:00:21,271 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-04 00:00:21,756 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-04 00:00:21,760 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-04 00:00:22,299 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-04 00:00:22,461 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-04 00:00:22,475 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 00:00:22,517 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 00:00:22,547 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/java.io.tmpdir/Jetty_localhost_43555_hdfs____ks49r4/webapp 2023-10-04 00:00:22,654 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43555 2023-10-04 00:00:22,688 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-04 00:00:22,689 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-04 00:00:23,218 WARN [Listener at localhost/43845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 00:00:23,280 WARN [Listener at localhost/43845] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 00:00:23,302 WARN [Listener at localhost/43845] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 00:00:23,310 INFO [Listener at localhost/43845] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 00:00:23,319 INFO [Listener at localhost/43845] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/java.io.tmpdir/Jetty_localhost_37919_datanode____wzc2hw/webapp 2023-10-04 00:00:23,411 INFO [Listener at localhost/43845] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37919 2023-10-04 00:00:23,910 WARN [Listener at localhost/38767] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 00:00:23,925 WARN [Listener at localhost/38767] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 00:00:23,929 WARN [Listener at localhost/38767] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 00:00:23,932 INFO [Listener at localhost/38767] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 00:00:23,945 INFO [Listener at localhost/38767] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/java.io.tmpdir/Jetty_localhost_37697_datanode____.rytsmh/webapp 2023-10-04 00:00:24,058 INFO [Listener at localhost/38767] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37697 2023-10-04 00:00:24,068 WARN [Listener at localhost/38601] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 00:00:24,101 WARN [Listener at localhost/38601] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 00:00:24,107 WARN [Listener at localhost/38601] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 00:00:24,110 INFO [Listener at localhost/38601] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 00:00:24,118 INFO [Listener at localhost/38601] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/java.io.tmpdir/Jetty_localhost_39525_datanode____.1jyhaf/webapp 2023-10-04 00:00:24,218 INFO [Listener at localhost/38601] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39525 2023-10-04 00:00:24,226 WARN [Listener at localhost/37259] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 00:00:25,274 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x171bdb9e83b55682: Processing first storage report for DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb from datanode 79551e84-44dd-466c-aa1c-dd0404cbf780 2023-10-04 00:00:25,275 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x171bdb9e83b55682: from storage DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb node DatanodeRegistration(127.0.0.1:42105, datanodeUuid=79551e84-44dd-466c-aa1c-dd0404cbf780, infoPort=45343, infoSecurePort=0, ipcPort=37259, storageInfo=lv=-57;cid=testClusterID;nsid=322940063;c=1696377621839), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-04 00:00:25,276 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc507ad22a58c6683: Processing first storage report for DS-7155d590-4be2-452f-aed7-dcbb2c62bc22 from datanode e2a82143-02a3-4523-8a8a-f010d22b3920 2023-10-04 00:00:25,276 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc507ad22a58c6683: from storage DS-7155d590-4be2-452f-aed7-dcbb2c62bc22 node DatanodeRegistration(127.0.0.1:44427, datanodeUuid=e2a82143-02a3-4523-8a8a-f010d22b3920, infoPort=41421, infoSecurePort=0, ipcPort=38601, storageInfo=lv=-57;cid=testClusterID;nsid=322940063;c=1696377621839), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 00:00:25,276 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xda5fbeedbb1a12d9: Processing first storage report for DS-ab1f502e-18fd-4c26-a712-dad97d903234 from datanode 9999fcff-7b53-4b4f-95e1-111edab39647 2023-10-04 00:00:25,276 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xda5fbeedbb1a12d9: from storage DS-ab1f502e-18fd-4c26-a712-dad97d903234 node DatanodeRegistration(127.0.0.1:36893, datanodeUuid=9999fcff-7b53-4b4f-95e1-111edab39647, infoPort=42287, infoSecurePort=0, ipcPort=38767, storageInfo=lv=-57;cid=testClusterID;nsid=322940063;c=1696377621839), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 00:00:25,276 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x171bdb9e83b55682: Processing first storage report for DS-bc08bc2e-4c9a-4018-beb1-4fc3476052fd from datanode 79551e84-44dd-466c-aa1c-dd0404cbf780 2023-10-04 00:00:25,276 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x171bdb9e83b55682: from storage DS-bc08bc2e-4c9a-4018-beb1-4fc3476052fd node DatanodeRegistration(127.0.0.1:42105, datanodeUuid=79551e84-44dd-466c-aa1c-dd0404cbf780, infoPort=45343, infoSecurePort=0, ipcPort=37259, storageInfo=lv=-57;cid=testClusterID;nsid=322940063;c=1696377621839), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 00:00:25,276 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc507ad22a58c6683: Processing first storage report for DS-e65f6384-3721-4df6-b6f4-394ce61dbe6d from datanode e2a82143-02a3-4523-8a8a-f010d22b3920 2023-10-04 00:00:25,277 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc507ad22a58c6683: from storage DS-e65f6384-3721-4df6-b6f4-394ce61dbe6d node DatanodeRegistration(127.0.0.1:44427, datanodeUuid=e2a82143-02a3-4523-8a8a-f010d22b3920, infoPort=41421, infoSecurePort=0, ipcPort=38601, storageInfo=lv=-57;cid=testClusterID;nsid=322940063;c=1696377621839), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 00:00:25,277 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xda5fbeedbb1a12d9: Processing first storage report for DS-aee4e682-1a7f-4152-9544-e48d37ae42cb from datanode 9999fcff-7b53-4b4f-95e1-111edab39647 2023-10-04 00:00:25,277 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xda5fbeedbb1a12d9: from storage DS-aee4e682-1a7f-4152-9544-e48d37ae42cb node DatanodeRegistration(127.0.0.1:36893, datanodeUuid=9999fcff-7b53-4b4f-95e1-111edab39647, infoPort=42287, infoSecurePort=0, ipcPort=38767, storageInfo=lv=-57;cid=testClusterID;nsid=322940063;c=1696377621839), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 00:00:25,296 DEBUG [Listener at localhost/37259] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725 2023-10-04 00:00:25,375 INFO [Listener at localhost/37259] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/zookeeper_0, clientPort=51489, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-04 00:00:25,394 INFO [Listener at localhost/37259] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51489 2023-10-04 00:00:25,401 INFO [Listener at localhost/37259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:25,404 INFO [Listener at localhost/37259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:26,049 INFO [Listener at localhost/37259] util.FSUtils(471): Created version file at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d with version=8 2023-10-04 00:00:26,049 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/hbase-staging 2023-10-04 00:00:26,390 INFO [Listener at localhost/37259] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-04 00:00:26,773 INFO [Listener at localhost/37259] client.ConnectionUtils(127): master/jenkins-hbase16:0 server-side Connection retries=45 2023-10-04 00:00:26,798 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:26,799 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:26,799 INFO [Listener at localhost/37259] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 00:00:26,799 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:26,799 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 00:00:26,916 INFO [Listener at localhost/37259] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 00:00:26,977 DEBUG [Listener at localhost/37259] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-04 00:00:27,054 INFO [Listener at localhost/37259] ipc.NettyRpcServer(120): Bind to /188.40.62.62:34927 2023-10-04 00:00:27,066 INFO [Listener at localhost/37259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:27,068 INFO [Listener at localhost/37259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:27,088 INFO [Listener at localhost/37259] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34927 connecting to ZooKeeper ensemble=127.0.0.1:51489 2023-10-04 00:00:27,218 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:349270x0, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 00:00:27,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34927-0x1010ebb4dca0000 connected 2023-10-04 00:00:27,295 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 00:00:27,296 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 00:00:27,307 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 00:00:27,313 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34927 2023-10-04 00:00:27,313 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34927 2023-10-04 00:00:27,314 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34927 2023-10-04 00:00:27,314 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34927 2023-10-04 00:00:27,315 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34927 2023-10-04 00:00:27,320 INFO [Listener at localhost/37259] master.HMaster(444): hbase.rootdir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d, hbase.cluster.distributed=false 2023-10-04 00:00:27,379 INFO [Listener at localhost/37259] client.ConnectionUtils(127): regionserver/jenkins-hbase16:0 server-side Connection retries=45 2023-10-04 00:00:27,379 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:27,380 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:27,380 INFO [Listener at localhost/37259] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 00:00:27,380 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:27,380 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 00:00:27,384 INFO [Listener at localhost/37259] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 00:00:27,387 INFO [Listener at localhost/37259] ipc.NettyRpcServer(120): Bind to /188.40.62.62:41265 2023-10-04 00:00:27,390 INFO [Listener at localhost/37259] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 00:00:27,395 INFO [Listener at localhost/37259] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 00:00:27,397 INFO [Listener at localhost/37259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:27,398 INFO [Listener at localhost/37259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:27,400 INFO [Listener at localhost/37259] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41265 connecting to ZooKeeper ensemble=127.0.0.1:51489 2023-10-04 00:00:27,410 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:412650x0, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 00:00:27,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41265-0x1010ebb4dca0001 connected 2023-10-04 00:00:27,412 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 00:00:27,413 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 00:00:27,414 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 00:00:27,415 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41265 2023-10-04 00:00:27,415 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41265 2023-10-04 00:00:27,419 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41265 2023-10-04 00:00:27,419 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41265 2023-10-04 00:00:27,419 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41265 2023-10-04 00:00:27,431 INFO [Listener at localhost/37259] client.ConnectionUtils(127): regionserver/jenkins-hbase16:0 server-side Connection retries=45 2023-10-04 00:00:27,432 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:27,432 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:27,432 INFO [Listener at localhost/37259] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 00:00:27,432 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:27,433 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 00:00:27,433 INFO [Listener at localhost/37259] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 00:00:27,434 INFO [Listener at localhost/37259] ipc.NettyRpcServer(120): Bind to /188.40.62.62:43449 2023-10-04 00:00:27,435 INFO [Listener at localhost/37259] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 00:00:27,435 INFO [Listener at localhost/37259] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 00:00:27,436 INFO [Listener at localhost/37259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:27,439 INFO [Listener at localhost/37259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:27,443 INFO [Listener at localhost/37259] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43449 connecting to ZooKeeper ensemble=127.0.0.1:51489 2023-10-04 00:00:27,452 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:434490x0, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 00:00:27,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43449-0x1010ebb4dca0002 connected 2023-10-04 00:00:27,454 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 00:00:27,454 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 00:00:27,455 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 00:00:27,456 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43449 2023-10-04 00:00:27,457 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43449 2023-10-04 00:00:27,457 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43449 2023-10-04 00:00:27,458 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43449 2023-10-04 00:00:27,458 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43449 2023-10-04 00:00:27,472 INFO [Listener at localhost/37259] client.ConnectionUtils(127): regionserver/jenkins-hbase16:0 server-side Connection retries=45 2023-10-04 00:00:27,473 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:27,473 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:27,473 INFO [Listener at localhost/37259] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 00:00:27,473 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 00:00:27,474 INFO [Listener at localhost/37259] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 00:00:27,474 INFO [Listener at localhost/37259] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 00:00:27,475 INFO [Listener at localhost/37259] ipc.NettyRpcServer(120): Bind to /188.40.62.62:44307 2023-10-04 00:00:27,476 INFO [Listener at localhost/37259] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 00:00:27,477 INFO [Listener at localhost/37259] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 00:00:27,478 INFO [Listener at localhost/37259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:27,480 INFO [Listener at localhost/37259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:27,482 INFO [Listener at localhost/37259] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44307 connecting to ZooKeeper ensemble=127.0.0.1:51489 2023-10-04 00:00:27,493 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:443070x0, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 00:00:27,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44307-0x1010ebb4dca0003 connected 2023-10-04 00:00:27,495 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 00:00:27,496 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 00:00:27,496 DEBUG [Listener at localhost/37259] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 00:00:27,497 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44307 2023-10-04 00:00:27,497 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44307 2023-10-04 00:00:27,497 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44307 2023-10-04 00:00:27,498 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44307 2023-10-04 00:00:27,499 DEBUG [Listener at localhost/37259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44307 2023-10-04 00:00:27,500 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase16.apache.org,34927,1696377626177 2023-10-04 00:00:27,519 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-04 00:00:27,521 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase16.apache.org,34927,1696377626177 2023-10-04 00:00:27,552 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 00:00:27,552 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 00:00:27,552 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 00:00:27,552 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 00:00:27,553 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:00:27,554 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-04 00:00:27,555 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase16.apache.org,34927,1696377626177 from backup master directory 2023-10-04 00:00:27,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-04 00:00:27,568 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase16.apache.org,34927,1696377626177 2023-10-04 00:00:27,569 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-04 00:00:27,569 WARN [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 00:00:27,570 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase16.apache.org,34927,1696377626177 2023-10-04 00:00:27,572 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-04 00:00:27,574 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-04 00:00:27,660 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/hbase.id with ID: ecc3522b-ff92-45c7-861f-a8fbf0715da8 2023-10-04 00:00:27,705 INFO [master/jenkins-hbase16:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 00:00:27,727 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:00:27,773 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4711e772 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:27,811 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61dad37a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:27,833 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-04 00:00:27,835 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-04 00:00:27,850 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-04 00:00:27,850 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-04 00:00:27,852 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-04 00:00:27,857 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-04 00:00:27,858 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 00:00:27,889 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/data/master/store-tmp 2023-10-04 00:00:27,924 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:27,924 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-04 00:00:27,925 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 00:00:27,925 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 00:00:27,925 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-04 00:00:27,925 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 00:00:27,925 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 00:00:27,925 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 00:00:27,927 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/WALs/jenkins-hbase16.apache.org,34927,1696377626177 2023-10-04 00:00:27,947 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C34927%2C1696377626177, suffix=, logDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/WALs/jenkins-hbase16.apache.org,34927,1696377626177, archiveDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/oldWALs, maxLogs=10 2023-10-04 00:00:28,002 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44427,DS-7155d590-4be2-452f-aed7-dcbb2c62bc22,DISK] 2023-10-04 00:00:28,002 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36893,DS-ab1f502e-18fd-4c26-a712-dad97d903234,DISK] 2023-10-04 00:00:28,002 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42105,DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb,DISK] 2023-10-04 00:00:28,011 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-04 00:00:28,085 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/WALs/jenkins-hbase16.apache.org,34927,1696377626177/jenkins-hbase16.apache.org%2C34927%2C1696377626177.1696377627957 2023-10-04 00:00:28,085 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44427,DS-7155d590-4be2-452f-aed7-dcbb2c62bc22,DISK], DatanodeInfoWithStorage[127.0.0.1:36893,DS-ab1f502e-18fd-4c26-a712-dad97d903234,DISK], DatanodeInfoWithStorage[127.0.0.1:42105,DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb,DISK]] 2023-10-04 00:00:28,086 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-04 00:00:28,087 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:28,091 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 00:00:28,093 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 00:00:28,160 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-04 00:00:28,168 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-04 00:00:28,194 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-04 00:00:28,206 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:28,211 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-04 00:00:28,213 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-04 00:00:28,228 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 00:00:28,234 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:00:28,236 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59439750, jitterRate=-0.11427870392799377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:00:28,236 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 00:00:28,237 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-04 00:00:28,266 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-04 00:00:28,266 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-04 00:00:28,270 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-04 00:00:28,272 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-04 00:00:28,304 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 32 msec 2023-10-04 00:00:28,305 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-04 00:00:28,330 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-04 00:00:28,336 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-04 00:00:28,358 INFO [master/jenkins-hbase16:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-04 00:00:28,362 INFO [master/jenkins-hbase16:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-04 00:00:28,363 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-04 00:00:28,368 INFO [master/jenkins-hbase16:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-04 00:00:28,372 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-04 00:00:28,402 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:00:28,404 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-04 00:00:28,404 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-04 00:00:28,421 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-04 00:00:28,435 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 00:00:28,435 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 00:00:28,435 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 00:00:28,435 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 00:00:28,436 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:00:28,436 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase16.apache.org,34927,1696377626177, sessionid=0x1010ebb4dca0000, setting cluster-up flag (Was=false) 2023-10-04 00:00:28,468 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:00:28,493 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-04 00:00:28,495 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase16.apache.org,34927,1696377626177 2023-10-04 00:00:28,518 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:00:28,544 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-04 00:00:28,545 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase16.apache.org,34927,1696377626177 2023-10-04 00:00:28,549 WARN [master/jenkins-hbase16:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp 2023-10-04 00:00:28,602 INFO [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(951): ClusterId : ecc3522b-ff92-45c7-861f-a8fbf0715da8 2023-10-04 00:00:28,603 INFO [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(951): ClusterId : ecc3522b-ff92-45c7-861f-a8fbf0715da8 2023-10-04 00:00:28,602 INFO [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(951): ClusterId : ecc3522b-ff92-45c7-861f-a8fbf0715da8 2023-10-04 00:00:28,610 DEBUG [RS:2;jenkins-hbase16:44307] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 00:00:28,610 DEBUG [RS:0;jenkins-hbase16:41265] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 00:00:28,610 DEBUG [RS:1;jenkins-hbase16:43449] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 00:00:28,624 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-04 00:00:28,629 DEBUG [RS:0;jenkins-hbase16:41265] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 00:00:28,629 DEBUG [RS:1;jenkins-hbase16:43449] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 00:00:28,629 DEBUG [RS:2;jenkins-hbase16:44307] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 00:00:28,629 INFO [master/jenkins-hbase16:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:28,629 DEBUG [RS:1;jenkins-hbase16:43449] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 00:00:28,629 DEBUG [RS:0;jenkins-hbase16:41265] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 00:00:28,629 DEBUG [RS:2;jenkins-hbase16:44307] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 00:00:28,629 INFO [master/jenkins-hbase16:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-04 00:00:28,645 DEBUG [RS:2;jenkins-hbase16:44307] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 00:00:28,645 DEBUG [RS:1;jenkins-hbase16:43449] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 00:00:28,645 DEBUG [RS:0;jenkins-hbase16:41265] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 00:00:28,648 DEBUG [RS:2;jenkins-hbase16:44307] zookeeper.ReadOnlyZKClient(139): Connect 0x38f9d3c7 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:28,650 DEBUG [RS:0;jenkins-hbase16:41265] zookeeper.ReadOnlyZKClient(139): Connect 0x6c11f2e7 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:28,650 DEBUG [RS:1;jenkins-hbase16:43449] zookeeper.ReadOnlyZKClient(139): Connect 0x03c3cac5 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:28,675 DEBUG [RS:2;jenkins-hbase16:44307] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@363e2aa8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:28,676 DEBUG [RS:1;jenkins-hbase16:43449] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d0434cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:28,676 DEBUG [RS:2;jenkins-hbase16:44307] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3201b8b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-10-04 00:00:28,676 DEBUG [RS:1;jenkins-hbase16:43449] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@93ba1b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-10-04 00:00:28,703 DEBUG [RS:0;jenkins-hbase16:41265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62d61115, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:28,703 DEBUG [RS:0;jenkins-hbase16:41265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23eb1b2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-10-04 00:00:28,714 DEBUG [RS:2;jenkins-hbase16:44307] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase16:44307 2023-10-04 00:00:28,715 DEBUG [RS:1;jenkins-hbase16:43449] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase16:43449 2023-10-04 00:00:28,716 DEBUG [RS:0;jenkins-hbase16:41265] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase16:41265 2023-10-04 00:00:28,719 INFO [RS:0;jenkins-hbase16:41265] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 00:00:28,719 INFO [RS:2;jenkins-hbase16:44307] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 00:00:28,720 INFO [RS:2;jenkins-hbase16:44307] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 00:00:28,719 INFO [RS:1;jenkins-hbase16:43449] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 00:00:28,720 INFO [RS:1;jenkins-hbase16:43449] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 00:00:28,719 INFO [RS:0;jenkins-hbase16:41265] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 00:00:28,720 DEBUG [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 00:00:28,720 DEBUG [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 00:00:28,720 DEBUG [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 00:00:28,721 INFO [RS:0;jenkins-hbase16:41265] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:28,721 INFO [RS:2;jenkins-hbase16:44307] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:28,721 DEBUG [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 00:00:28,721 INFO [RS:1;jenkins-hbase16:43449] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:28,721 DEBUG [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 00:00:28,721 DEBUG [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 00:00:28,723 INFO [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase16.apache.org,34927,1696377626177 with isa=jenkins-hbase16.apache.org/188.40.62.62:41265, startcode=1696377627379 2023-10-04 00:00:28,723 INFO [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase16.apache.org,34927,1696377626177 with isa=jenkins-hbase16.apache.org/188.40.62.62:43449, startcode=1696377627431 2023-10-04 00:00:28,723 INFO [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase16.apache.org,34927,1696377626177 with isa=jenkins-hbase16.apache.org/188.40.62.62:44307, startcode=1696377627472 2023-10-04 00:00:28,738 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-04 00:00:28,741 DEBUG [RS:1;jenkins-hbase16:43449] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 00:00:28,741 DEBUG [RS:2;jenkins-hbase16:44307] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 00:00:28,741 DEBUG [RS:0;jenkins-hbase16:41265] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 00:00:28,748 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-10-04 00:00:28,748 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-10-04 00:00:28,748 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-10-04 00:00:28,748 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2023-10-04 00:00:28,748 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase16:0, corePoolSize=10, maxPoolSize=10 2023-10-04 00:00:28,748 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:28,748 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-10-04 00:00:28,749 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:28,750 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696377658750 2023-10-04 00:00:28,752 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-04 00:00:28,759 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-04 00:00:28,759 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-04 00:00:28,768 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 00:00:28,769 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-04 00:00:28,779 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-04 00:00:28,780 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-04 00:00:28,780 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-04 00:00:28,780 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-04 00:00:28,781 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:28,782 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-04 00:00:28,784 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-04 00:00:28,784 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-04 00:00:28,786 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-04 00:00:28,787 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-04 00:00:28,789 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1696377628789,5,FailOnTimeoutGroup] 2023-10-04 00:00:28,790 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1696377628790,5,FailOnTimeoutGroup] 2023-10-04 00:00:28,791 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:28,791 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-04 00:00:28,793 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:28,794 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:28,807 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40037, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 00:00:28,807 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:34335, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 00:00:28,807 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:60081, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 00:00:28,824 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-04 00:00:28,825 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-04 00:00:28,825 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:00:28,827 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34927] master.ServerManager(394): Registering regionserver=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:28,839 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34927] master.ServerManager(394): Registering regionserver=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:28,840 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34927] master.ServerManager(394): Registering regionserver=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:28,851 DEBUG [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:00:28,852 DEBUG [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:00:28,852 DEBUG [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43845 2023-10-04 00:00:28,852 DEBUG [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 00:00:28,852 DEBUG [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:00:28,852 DEBUG [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43845 2023-10-04 00:00:28,853 DEBUG [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43845 2023-10-04 00:00:28,853 DEBUG [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 00:00:28,853 DEBUG [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 00:00:28,856 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:28,859 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-04 00:00:28,861 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/info 2023-10-04 00:00:28,862 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-04 00:00:28,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:28,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-04 00:00:28,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/rep_barrier 2023-10-04 00:00:28,866 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 00:00:28,867 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-04 00:00:28,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:28,869 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-04 00:00:28,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/table 2023-10-04 00:00:28,871 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-04 00:00:28,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:28,874 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740 2023-10-04 00:00:28,875 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740 2023-10-04 00:00:28,879 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-04 00:00:28,881 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-04 00:00:28,889 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:00:28,890 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70138707, jitterRate=0.045148178935050964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-04 00:00:28,891 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-04 00:00:28,891 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-04 00:00:28,891 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-04 00:00:28,891 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-04 00:00:28,891 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-04 00:00:28,891 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-04 00:00:28,896 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-04 00:00:28,896 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-04 00:00:28,902 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-04 00:00:28,902 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-04 00:00:28,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-04 00:00:28,922 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-04 00:00:28,925 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-04 00:00:28,963 DEBUG [RS:0;jenkins-hbase16:41265] zookeeper.ZKUtil(162): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:28,963 WARN [RS:0;jenkins-hbase16:41265] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 00:00:28,963 DEBUG [RS:1;jenkins-hbase16:43449] zookeeper.ZKUtil(162): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:28,963 INFO [RS:0;jenkins-hbase16:41265] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 00:00:28,964 DEBUG [RS:2;jenkins-hbase16:44307] zookeeper.ZKUtil(162): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:28,963 WARN [RS:1;jenkins-hbase16:43449] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 00:00:28,964 DEBUG [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:28,964 INFO [RS:1;jenkins-hbase16:43449] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 00:00:28,964 WARN [RS:2;jenkins-hbase16:44307] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 00:00:28,965 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase16.apache.org,43449,1696377627431] 2023-10-04 00:00:28,965 INFO [RS:2;jenkins-hbase16:44307] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 00:00:28,965 DEBUG [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:28,965 DEBUG [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:28,965 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase16.apache.org,41265,1696377627379] 2023-10-04 00:00:28,965 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase16.apache.org,44307,1696377627472] 2023-10-04 00:00:28,977 DEBUG [RS:1;jenkins-hbase16:43449] zookeeper.ZKUtil(162): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:28,977 DEBUG [RS:2;jenkins-hbase16:44307] zookeeper.ZKUtil(162): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:28,977 DEBUG [RS:0;jenkins-hbase16:41265] zookeeper.ZKUtil(162): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:28,978 DEBUG [RS:1;jenkins-hbase16:43449] zookeeper.ZKUtil(162): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:28,978 DEBUG [RS:2;jenkins-hbase16:44307] zookeeper.ZKUtil(162): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:28,978 DEBUG [RS:0;jenkins-hbase16:41265] zookeeper.ZKUtil(162): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:28,978 DEBUG [RS:1;jenkins-hbase16:43449] zookeeper.ZKUtil(162): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:28,978 DEBUG [RS:2;jenkins-hbase16:44307] zookeeper.ZKUtil(162): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:28,979 DEBUG [RS:0;jenkins-hbase16:41265] zookeeper.ZKUtil(162): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:28,989 DEBUG [RS:2;jenkins-hbase16:44307] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 00:00:28,989 DEBUG [RS:1;jenkins-hbase16:43449] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 00:00:28,989 DEBUG [RS:0;jenkins-hbase16:41265] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 00:00:28,998 INFO [RS:2;jenkins-hbase16:44307] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 00:00:28,999 INFO [RS:0;jenkins-hbase16:41265] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 00:00:28,998 INFO [RS:1;jenkins-hbase16:43449] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 00:00:29,025 INFO [RS:0;jenkins-hbase16:41265] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 00:00:29,025 INFO [RS:2;jenkins-hbase16:44307] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 00:00:29,025 INFO [RS:1;jenkins-hbase16:43449] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 00:00:29,030 INFO [RS:1;jenkins-hbase16:43449] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 00:00:29,030 INFO [RS:2;jenkins-hbase16:44307] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 00:00:29,030 INFO [RS:1;jenkins-hbase16:43449] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,030 INFO [RS:0;jenkins-hbase16:41265] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 00:00:29,030 INFO [RS:2;jenkins-hbase16:44307] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,031 INFO [RS:0;jenkins-hbase16:41265] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,031 INFO [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 00:00:29,032 INFO [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 00:00:29,031 INFO [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 00:00:29,040 INFO [RS:1;jenkins-hbase16:43449] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,040 INFO [RS:0;jenkins-hbase16:41265] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,040 INFO [RS:2;jenkins-hbase16:44307] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,041 DEBUG [RS:1;jenkins-hbase16:43449] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,041 DEBUG [RS:2;jenkins-hbase16:44307] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,041 DEBUG [RS:0;jenkins-hbase16:41265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,041 DEBUG [RS:2;jenkins-hbase16:44307] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,041 DEBUG [RS:0;jenkins-hbase16:41265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,041 DEBUG [RS:1;jenkins-hbase16:43449] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:0;jenkins-hbase16:41265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:1;jenkins-hbase16:43449] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:0;jenkins-hbase16:41265] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:1;jenkins-hbase16:43449] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:0;jenkins-hbase16:41265] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:1;jenkins-hbase16:43449] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:0;jenkins-hbase16:41265] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-10-04 00:00:29,042 DEBUG [RS:1;jenkins-hbase16:43449] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-10-04 00:00:29,042 DEBUG [RS:0;jenkins-hbase16:41265] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:1;jenkins-hbase16:43449] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,041 DEBUG [RS:2;jenkins-hbase16:44307] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:1;jenkins-hbase16:43449] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:2;jenkins-hbase16:44307] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,043 DEBUG [RS:1;jenkins-hbase16:43449] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,043 DEBUG [RS:2;jenkins-hbase16:44307] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,042 DEBUG [RS:0;jenkins-hbase16:41265] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,043 DEBUG [RS:2;jenkins-hbase16:44307] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2023-10-04 00:00:29,043 DEBUG [RS:1;jenkins-hbase16:43449] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,043 DEBUG [RS:2;jenkins-hbase16:44307] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,043 DEBUG [RS:0;jenkins-hbase16:41265] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,043 DEBUG [RS:2;jenkins-hbase16:44307] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,043 DEBUG [RS:0;jenkins-hbase16:41265] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,044 DEBUG [RS:2;jenkins-hbase16:44307] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,044 DEBUG [RS:2;jenkins-hbase16:44307] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2023-10-04 00:00:29,047 INFO [RS:1;jenkins-hbase16:43449] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,048 INFO [RS:1;jenkins-hbase16:43449] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,048 INFO [RS:1;jenkins-hbase16:43449] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,048 INFO [RS:2;jenkins-hbase16:44307] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,048 INFO [RS:2;jenkins-hbase16:44307] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,048 INFO [RS:2;jenkins-hbase16:44307] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,052 INFO [RS:0;jenkins-hbase16:41265] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,052 INFO [RS:0;jenkins-hbase16:41265] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,052 INFO [RS:0;jenkins-hbase16:41265] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,065 INFO [RS:1;jenkins-hbase16:43449] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 00:00:29,065 INFO [RS:2;jenkins-hbase16:44307] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 00:00:29,066 INFO [RS:0;jenkins-hbase16:41265] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 00:00:29,069 INFO [RS:2;jenkins-hbase16:44307] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,44307,1696377627472-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,069 INFO [RS:0;jenkins-hbase16:41265] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,41265,1696377627379-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,069 INFO [RS:1;jenkins-hbase16:43449] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,43449,1696377627431-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,077 DEBUG [jenkins-hbase16:34927] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-04 00:00:29,082 DEBUG [jenkins-hbase16:34927] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-10-04 00:00:29,088 DEBUG [jenkins-hbase16:34927] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 00:00:29,088 DEBUG [jenkins-hbase16:34927] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 00:00:29,088 DEBUG [jenkins-hbase16:34927] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 00:00:29,088 DEBUG [jenkins-hbase16:34927] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 00:00:29,093 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase16.apache.org,41265,1696377627379, state=OPENING 2023-10-04 00:00:29,095 INFO [RS:2;jenkins-hbase16:44307] regionserver.Replication(203): jenkins-hbase16.apache.org,44307,1696377627472 started 2023-10-04 00:00:29,095 INFO [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1637): Serving as jenkins-hbase16.apache.org,44307,1696377627472, RpcServer on jenkins-hbase16.apache.org/188.40.62.62:44307, sessionid=0x1010ebb4dca0003 2023-10-04 00:00:29,099 INFO [RS:0;jenkins-hbase16:41265] regionserver.Replication(203): jenkins-hbase16.apache.org,41265,1696377627379 started 2023-10-04 00:00:29,099 INFO [RS:1;jenkins-hbase16:43449] regionserver.Replication(203): jenkins-hbase16.apache.org,43449,1696377627431 started 2023-10-04 00:00:29,099 INFO [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1637): Serving as jenkins-hbase16.apache.org,41265,1696377627379, RpcServer on jenkins-hbase16.apache.org/188.40.62.62:41265, sessionid=0x1010ebb4dca0001 2023-10-04 00:00:29,099 DEBUG [RS:2;jenkins-hbase16:44307] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 00:00:29,099 DEBUG [RS:0;jenkins-hbase16:41265] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 00:00:29,099 DEBUG [RS:2;jenkins-hbase16:44307] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:29,099 INFO [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1637): Serving as jenkins-hbase16.apache.org,43449,1696377627431, RpcServer on jenkins-hbase16.apache.org/188.40.62.62:43449, sessionid=0x1010ebb4dca0002 2023-10-04 00:00:29,100 DEBUG [RS:2;jenkins-hbase16:44307] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,44307,1696377627472' 2023-10-04 00:00:29,099 DEBUG [RS:0;jenkins-hbase16:41265] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:29,100 DEBUG [RS:2;jenkins-hbase16:44307] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 00:00:29,100 DEBUG [RS:1;jenkins-hbase16:43449] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 00:00:29,100 DEBUG [RS:0;jenkins-hbase16:41265] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,41265,1696377627379' 2023-10-04 00:00:29,101 DEBUG [RS:0;jenkins-hbase16:41265] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 00:00:29,101 DEBUG [RS:1;jenkins-hbase16:43449] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:29,101 DEBUG [RS:1;jenkins-hbase16:43449] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,43449,1696377627431' 2023-10-04 00:00:29,101 DEBUG [RS:1;jenkins-hbase16:43449] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 00:00:29,101 DEBUG [RS:2;jenkins-hbase16:44307] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 00:00:29,101 DEBUG [RS:1;jenkins-hbase16:43449] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 00:00:29,101 DEBUG [RS:0;jenkins-hbase16:41265] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 00:00:29,102 DEBUG [RS:2;jenkins-hbase16:44307] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 00:00:29,102 DEBUG [RS:2;jenkins-hbase16:44307] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 00:00:29,102 DEBUG [RS:2;jenkins-hbase16:44307] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:29,102 DEBUG [RS:2;jenkins-hbase16:44307] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,44307,1696377627472' 2023-10-04 00:00:29,102 DEBUG [RS:2;jenkins-hbase16:44307] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:29,103 DEBUG [RS:0;jenkins-hbase16:41265] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 00:00:29,103 DEBUG [RS:0;jenkins-hbase16:41265] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 00:00:29,103 DEBUG [RS:0;jenkins-hbase16:41265] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:29,103 DEBUG [RS:0;jenkins-hbase16:41265] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,41265,1696377627379' 2023-10-04 00:00:29,103 DEBUG [RS:0;jenkins-hbase16:41265] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:29,106 DEBUG [RS:1;jenkins-hbase16:43449] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 00:00:29,106 DEBUG [RS:0;jenkins-hbase16:41265] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:29,106 DEBUG [RS:2;jenkins-hbase16:44307] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:29,106 DEBUG [RS:1;jenkins-hbase16:43449] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 00:00:29,107 DEBUG [RS:1;jenkins-hbase16:43449] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:29,107 DEBUG [RS:1;jenkins-hbase16:43449] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,43449,1696377627431' 2023-10-04 00:00:29,107 DEBUG [RS:1;jenkins-hbase16:43449] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:29,118 DEBUG [RS:1;jenkins-hbase16:43449] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:29,118 DEBUG [RS:0;jenkins-hbase16:41265] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 00:00:29,118 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-04 00:00:29,118 DEBUG [RS:2;jenkins-hbase16:44307] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 00:00:29,119 INFO [RS:0;jenkins-hbase16:41265] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 00:00:29,119 INFO [RS:2;jenkins-hbase16:44307] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 00:00:29,120 INFO [RS:0;jenkins-hbase16:41265] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 00:00:29,120 INFO [RS:2;jenkins-hbase16:44307] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 00:00:29,120 DEBUG [RS:1;jenkins-hbase16:43449] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 00:00:29,120 INFO [RS:1;jenkins-hbase16:43449] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 00:00:29,120 INFO [RS:1;jenkins-hbase16:43449] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 00:00:29,127 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:00:29,127 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-04 00:00:29,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:00:29,231 INFO [RS:2;jenkins-hbase16:44307] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C44307%2C1696377627472, suffix=, logDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,44307,1696377627472, archiveDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/oldWALs, maxLogs=32 2023-10-04 00:00:29,231 INFO [RS:1;jenkins-hbase16:43449] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C43449%2C1696377627431, suffix=, logDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,43449,1696377627431, archiveDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/oldWALs, maxLogs=32 2023-10-04 00:00:29,231 INFO [RS:0;jenkins-hbase16:41265] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C41265%2C1696377627379, suffix=, logDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,41265,1696377627379, archiveDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/oldWALs, maxLogs=32 2023-10-04 00:00:29,253 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44427,DS-7155d590-4be2-452f-aed7-dcbb2c62bc22,DISK] 2023-10-04 00:00:29,253 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36893,DS-ab1f502e-18fd-4c26-a712-dad97d903234,DISK] 2023-10-04 00:00:29,254 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42105,DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb,DISK] 2023-10-04 00:00:29,271 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42105,DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb,DISK] 2023-10-04 00:00:29,271 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44427,DS-7155d590-4be2-452f-aed7-dcbb2c62bc22,DISK] 2023-10-04 00:00:29,272 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36893,DS-ab1f502e-18fd-4c26-a712-dad97d903234,DISK] 2023-10-04 00:00:29,284 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36893,DS-ab1f502e-18fd-4c26-a712-dad97d903234,DISK] 2023-10-04 00:00:29,284 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42105,DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb,DISK] 2023-10-04 00:00:29,287 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44427,DS-7155d590-4be2-452f-aed7-dcbb2c62bc22,DISK] 2023-10-04 00:00:29,287 INFO [RS:0;jenkins-hbase16:41265] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,41265,1696377627379/jenkins-hbase16.apache.org%2C41265%2C1696377627379.1696377629236 2023-10-04 00:00:29,288 DEBUG [RS:0;jenkins-hbase16:41265] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44427,DS-7155d590-4be2-452f-aed7-dcbb2c62bc22,DISK], DatanodeInfoWithStorage[127.0.0.1:36893,DS-ab1f502e-18fd-4c26-a712-dad97d903234,DISK], DatanodeInfoWithStorage[127.0.0.1:42105,DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb,DISK]] 2023-10-04 00:00:29,298 INFO [RS:2;jenkins-hbase16:44307] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,44307,1696377627472/jenkins-hbase16.apache.org%2C44307%2C1696377627472.1696377629236 2023-10-04 00:00:29,298 INFO [RS:1;jenkins-hbase16:43449] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,43449,1696377627431/jenkins-hbase16.apache.org%2C43449%2C1696377627431.1696377629236 2023-10-04 00:00:29,298 DEBUG [RS:2;jenkins-hbase16:44307] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36893,DS-ab1f502e-18fd-4c26-a712-dad97d903234,DISK], DatanodeInfoWithStorage[127.0.0.1:44427,DS-7155d590-4be2-452f-aed7-dcbb2c62bc22,DISK], DatanodeInfoWithStorage[127.0.0.1:42105,DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb,DISK]] 2023-10-04 00:00:29,298 DEBUG [RS:1;jenkins-hbase16:43449] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44427,DS-7155d590-4be2-452f-aed7-dcbb2c62bc22,DISK], DatanodeInfoWithStorage[127.0.0.1:36893,DS-ab1f502e-18fd-4c26-a712-dad97d903234,DISK], DatanodeInfoWithStorage[127.0.0.1:42105,DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb,DISK]] 2023-10-04 00:00:29,325 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:29,329 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 00:00:29,332 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:58346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 00:00:29,347 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-04 00:00:29,348 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 00:00:29,352 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C41265%2C1696377627379.meta, suffix=.meta, logDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,41265,1696377627379, archiveDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/oldWALs, maxLogs=32 2023-10-04 00:00:29,372 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36893,DS-ab1f502e-18fd-4c26-a712-dad97d903234,DISK] 2023-10-04 00:00:29,372 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42105,DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb,DISK] 2023-10-04 00:00:29,373 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44427,DS-7155d590-4be2-452f-aed7-dcbb2c62bc22,DISK] 2023-10-04 00:00:29,380 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/WALs/jenkins-hbase16.apache.org,41265,1696377627379/jenkins-hbase16.apache.org%2C41265%2C1696377627379.meta.1696377629354.meta 2023-10-04 00:00:29,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42105,DS-385e6ba0-c0d3-469d-ad2e-04b1749ac6bb,DISK], DatanodeInfoWithStorage[127.0.0.1:36893,DS-ab1f502e-18fd-4c26-a712-dad97d903234,DISK], DatanodeInfoWithStorage[127.0.0.1:44427,DS-7155d590-4be2-452f-aed7-dcbb2c62bc22,DISK]] 2023-10-04 00:00:29,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-04 00:00:29,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-04 00:00:29,383 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:29,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-04 00:00:29,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-04 00:00:29,387 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-04 00:00:29,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-04 00:00:29,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:29,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-04 00:00:29,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-04 00:00:29,401 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-04 00:00:29,403 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/info 2023-10-04 00:00:29,403 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/info 2023-10-04 00:00:29,404 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-04 00:00:29,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:29,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-04 00:00:29,407 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/rep_barrier 2023-10-04 00:00:29,407 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/rep_barrier 2023-10-04 00:00:29,407 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-04 00:00:29,408 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:29,408 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-04 00:00:29,410 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/table 2023-10-04 00:00:29,410 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/table 2023-10-04 00:00:29,410 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-04 00:00:29,413 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:29,416 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740 2023-10-04 00:00:29,419 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740 2023-10-04 00:00:29,424 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-04 00:00:29,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-04 00:00:29,433 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75055589, jitterRate=0.11841543018817902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-04 00:00:29,436 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-04 00:00:29,451 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696377629316 2023-10-04 00:00:29,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-04 00:00:29,475 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-04 00:00:29,475 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase16.apache.org,41265,1696377627379, state=OPEN 2023-10-04 00:00:29,485 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-04 00:00:29,485 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-04 00:00:29,490 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-04 00:00:29,490 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase16.apache.org,41265,1696377627379 in 355 msec 2023-10-04 00:00:29,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-04 00:00:29,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 582 msec 2023-10-04 00:00:29,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 866 msec 2023-10-04 00:00:29,510 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696377629510, completionTime=-1 2023-10-04 00:00:29,510 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-04 00:00:29,510 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-04 00:00:29,574 DEBUG [hconnection-0x74eaffc3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:29,577 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:58356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:29,598 INFO [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-04 00:00:29,598 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696377689598 2023-10-04 00:00:29,598 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696377749598 2023-10-04 00:00:29,598 INFO [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 87 msec 2023-10-04 00:00:29,645 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,34927,1696377626177-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,645 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,34927,1696377626177-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,645 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,34927,1696377626177-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,647 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase16:34927, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,647 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-04 00:00:29,659 DEBUG [master/jenkins-hbase16:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-04 00:00:29,668 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-04 00:00:29,669 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 00:00:29,679 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-04 00:00:29,682 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 00:00:29,685 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 00:00:29,710 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:00:29,712 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5 empty. 2023-10-04 00:00:29,713 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:00:29,713 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-04 00:00:29,759 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-04 00:00:29,761 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec735c15bdc23c776aec5f35d2d224b5, NAME => 'hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:00:29,782 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:29,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ec735c15bdc23c776aec5f35d2d224b5, disabling compactions & flushes 2023-10-04 00:00:29,783 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:00:29,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:00:29,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. after waiting 0 ms 2023-10-04 00:00:29,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:00:29,783 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:00:29,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ec735c15bdc23c776aec5f35d2d224b5: 2023-10-04 00:00:29,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 00:00:29,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696377629792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377629792"}]},"ts":"1696377629792"} 2023-10-04 00:00:29,836 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-04 00:00:29,839 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 00:00:29,843 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377629839"}]},"ts":"1696377629839"} 2023-10-04 00:00:29,848 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-04 00:00:29,870 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-10-04 00:00:29,871 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 00:00:29,871 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 00:00:29,871 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 00:00:29,871 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 00:00:29,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ec735c15bdc23c776aec5f35d2d224b5, ASSIGN}] 2023-10-04 00:00:29,877 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ec735c15bdc23c776aec5f35d2d224b5, ASSIGN 2023-10-04 00:00:29,879 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ec735c15bdc23c776aec5f35d2d224b5, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,44307,1696377627472; forceNewPlan=false, retain=false 2023-10-04 00:00:30,031 INFO [jenkins-hbase16:34927] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 00:00:30,032 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ec735c15bdc23c776aec5f35d2d224b5, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:30,033 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696377630032"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377630032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377630032"}]},"ts":"1696377630032"} 2023-10-04 00:00:30,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ec735c15bdc23c776aec5f35d2d224b5, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:00:30,194 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:30,195 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 00:00:30,199 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:55972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 00:00:30,205 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:00:30,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec735c15bdc23c776aec5f35d2d224b5, NAME => 'hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5.', STARTKEY => '', ENDKEY => ''} 2023-10-04 00:00:30,207 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. service=AccessControlService 2023-10-04 00:00:30,207 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:30,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:00:30,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:30,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:00:30,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:00:30,211 INFO [StoreOpener-ec735c15bdc23c776aec5f35d2d224b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:00:30,213 DEBUG [StoreOpener-ec735c15bdc23c776aec5f35d2d224b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5/info 2023-10-04 00:00:30,213 DEBUG [StoreOpener-ec735c15bdc23c776aec5f35d2d224b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5/info 2023-10-04 00:00:30,213 INFO [StoreOpener-ec735c15bdc23c776aec5f35d2d224b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec735c15bdc23c776aec5f35d2d224b5 columnFamilyName info 2023-10-04 00:00:30,214 INFO [StoreOpener-ec735c15bdc23c776aec5f35d2d224b5-1] regionserver.HStore(310): Store=ec735c15bdc23c776aec5f35d2d224b5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:30,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:00:30,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:00:30,222 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:00:30,227 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:00:30,228 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened ec735c15bdc23c776aec5f35d2d224b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59975887, jitterRate=-0.10628964006900787}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:00:30,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for ec735c15bdc23c776aec5f35d2d224b5: 2023-10-04 00:00:30,230 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5., pid=6, masterSystemTime=1696377630194 2023-10-04 00:00:30,235 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:00:30,235 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:00:30,237 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ec735c15bdc23c776aec5f35d2d224b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:30,237 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696377630236"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377630236"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377630236"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377630236"}]},"ts":"1696377630236"} 2023-10-04 00:00:30,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-04 00:00:30,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ec735c15bdc23c776aec5f35d2d224b5, server=jenkins-hbase16.apache.org,44307,1696377627472 in 200 msec 2023-10-04 00:00:30,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-04 00:00:30,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ec735c15bdc23c776aec5f35d2d224b5, ASSIGN in 371 msec 2023-10-04 00:00:30,250 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 00:00:30,250 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377630250"}]},"ts":"1696377630250"} 2023-10-04 00:00:30,252 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-04 00:00:30,287 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-04 00:00:30,287 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 00:00:30,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 617 msec 2023-10-04 00:00:30,293 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-04 00:00:30,293 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:00:30,313 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:30,314 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:55986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:30,327 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-04 00:00:30,377 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-04 00:00:30,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 68 msec 2023-10-04 00:00:30,396 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-04 00:00:30,416 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-04 00:00:30,431 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 35 msec 2023-10-04 00:00:30,460 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-04 00:00:30,477 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-04 00:00:30,477 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.907sec 2023-10-04 00:00:30,480 INFO [master/jenkins-hbase16:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-04 00:00:30,482 INFO [master/jenkins-hbase16:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-04 00:00:30,482 INFO [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-04 00:00:30,484 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,34927,1696377626177-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-04 00:00:30,484 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,34927,1696377626177-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-04 00:00:30,507 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 00:00:30,509 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-04 00:00:30,512 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 00:00:30,513 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 00:00:30,514 DEBUG [Listener at localhost/37259] zookeeper.ReadOnlyZKClient(139): Connect 0x6194af79 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:30,518 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:00:30,519 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-04 00:00:30,519 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00 empty. 2023-10-04 00:00:30,521 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:00:30,521 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-04 00:00:30,528 DEBUG [Listener at localhost/37259] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a774a27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:30,529 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 00:00:30,548 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-04 00:00:30,550 DEBUG [hconnection-0x230246c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:30,550 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ce48a7339c79d185ddb5ec0bd7189f00, NAME => 'hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:00:30,572 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:58366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:30,577 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase16.apache.org,34927,1696377626177 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/test.cache.data in system properties and HBase conf 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop.tmp.dir in system properties and HBase conf 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop.log.dir in system properties and HBase conf 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-04 00:00:30,578 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:30,578 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 00:00:30,579 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ce48a7339c79d185ddb5ec0bd7189f00, disabling compactions & flushes 2023-10-04 00:00:30,579 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-04 00:00:30,579 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:00:30,579 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-04 00:00:30,579 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:00:30,579 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 00:00:30,579 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. after waiting 0 ms 2023-10-04 00:00:30,579 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 00:00:30,579 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:00:30,579 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-04 00:00:30,579 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:00:30,579 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/nfs.dump.dir in system properties and HBase conf 2023-10-04 00:00:30,579 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ce48a7339c79d185ddb5ec0bd7189f00: 2023-10-04 00:00:30,579 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/java.io.tmpdir in system properties and HBase conf 2023-10-04 00:00:30,579 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 00:00:30,580 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-04 00:00:30,580 INFO [Listener at localhost/37259] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-04 00:00:30,584 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 00:00:30,585 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696377630585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377630585"}]},"ts":"1696377630585"} 2023-10-04 00:00:30,588 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-04 00:00:30,589 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 00:00:30,590 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377630589"}]},"ts":"1696377630589"} 2023-10-04 00:00:30,592 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-04 00:00:30,611 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-10-04 00:00:30,612 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 00:00:30,612 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 00:00:30,612 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 00:00:30,612 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 00:00:30,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ce48a7339c79d185ddb5ec0bd7189f00, ASSIGN}] 2023-10-04 00:00:30,615 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ce48a7339c79d185ddb5ec0bd7189f00, ASSIGN 2023-10-04 00:00:30,617 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ce48a7339c79d185ddb5ec0bd7189f00, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,43449,1696377627431; forceNewPlan=false, retain=false 2023-10-04 00:00:30,634 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 00:00:30,767 INFO [jenkins-hbase16:34927] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 00:00:30,768 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ce48a7339c79d185ddb5ec0bd7189f00, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:30,768 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696377630768"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377630768"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377630768"}]},"ts":"1696377630768"} 2023-10-04 00:00:30,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ce48a7339c79d185ddb5ec0bd7189f00, server=jenkins-hbase16.apache.org,43449,1696377627431}] 2023-10-04 00:00:30,834 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 00:00:30,926 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:30,927 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 00:00:30,930 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:51764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 00:00:30,936 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:00:30,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce48a7339c79d185ddb5ec0bd7189f00, NAME => 'hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00.', STARTKEY => '', ENDKEY => ''} 2023-10-04 00:00:30,937 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. service=AccessControlService 2023-10-04 00:00:30,937 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:30,937 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:00:30,937 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:30,937 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:00:30,937 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:00:30,939 INFO [StoreOpener-ce48a7339c79d185ddb5ec0bd7189f00-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:00:30,942 DEBUG [StoreOpener-ce48a7339c79d185ddb5ec0bd7189f00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00/l 2023-10-04 00:00:30,942 DEBUG [StoreOpener-ce48a7339c79d185ddb5ec0bd7189f00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00/l 2023-10-04 00:00:30,943 INFO [StoreOpener-ce48a7339c79d185ddb5ec0bd7189f00-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce48a7339c79d185ddb5ec0bd7189f00 columnFamilyName l 2023-10-04 00:00:30,944 INFO [StoreOpener-ce48a7339c79d185ddb5ec0bd7189f00-1] regionserver.HStore(310): Store=ce48a7339c79d185ddb5ec0bd7189f00/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:30,946 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:00:30,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:00:30,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:00:30,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:00:30,962 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened ce48a7339c79d185ddb5ec0bd7189f00; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71908489, jitterRate=0.07151998579502106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:00:30,963 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for ce48a7339c79d185ddb5ec0bd7189f00: 2023-10-04 00:00:30,964 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00., pid=11, masterSystemTime=1696377630926 2023-10-04 00:00:30,968 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:00:30,969 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:00:30,970 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ce48a7339c79d185ddb5ec0bd7189f00, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:30,971 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696377630970"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377630970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377630970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377630970"}]},"ts":"1696377630970"} 2023-10-04 00:00:30,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-04 00:00:30,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ce48a7339c79d185ddb5ec0bd7189f00, server=jenkins-hbase16.apache.org,43449,1696377627431 in 202 msec 2023-10-04 00:00:30,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-04 00:00:30,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ce48a7339c79d185ddb5ec0bd7189f00, ASSIGN in 366 msec 2023-10-04 00:00:30,983 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 00:00:30,983 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377630983"}]},"ts":"1696377630983"} 2023-10-04 00:00:30,985 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-04 00:00:30,995 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 00:00:30,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 488 msec 2023-10-04 00:00:31,135 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 00:00:31,135 INFO [master/jenkins-hbase16:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-04 00:00:31,144 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-04 00:00:31,576 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 00:00:31,862 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 00:00:31,868 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/java.io.tmpdir/Jetty_jenkins.hbase16_apache_org_36287_jobhistory____.8vdz4s/webapp 2023-10-04 00:00:32,013 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-04 00:00:32,013 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-04 00:00:32,013 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 00:00:32,016 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 00:00:32,089 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:32,363 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:32,723 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-04 00:00:32,763 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:36287 2023-10-04 00:00:33,058 WARN [Listener at jenkins-hbase16.apache.org/45015] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 00:00:33,261 WARN [Listener at jenkins-hbase16.apache.org/45015] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 00:00:33,262 INFO [Listener at jenkins-hbase16.apache.org/45015] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 00:00:33,271 INFO [Listener at jenkins-hbase16.apache.org/45015] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/java.io.tmpdir/Jetty_jenkins.hbase16_apache_org_43251_cluster____4dnlm0/webapp 2023-10-04 00:00:33,335 INFO [Listener at jenkins-hbase16.apache.org/45015] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 00:00:33,335 INFO [Listener at jenkins-hbase16.apache.org/45015] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-04 00:00:33,336 INFO [Listener at jenkins-hbase16.apache.org/45015] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 00:00:33,336 INFO [Listener at jenkins-hbase16.apache.org/45015] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 00:00:33,347 INFO [Listener at jenkins-hbase16.apache.org/45015] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:33,525 INFO [Listener at jenkins-hbase16.apache.org/45015] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:33,655 INFO [Listener at jenkins-hbase16.apache.org/45015] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:33,668 INFO [Listener at jenkins-hbase16.apache.org/45015] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:43251 2023-10-04 00:00:34,102 WARN [Listener at jenkins-hbase16.apache.org/38477] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 00:00:34,129 WARN [Listener at jenkins-hbase16.apache.org/38477] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 00:00:34,129 INFO [Listener at jenkins-hbase16.apache.org/38477] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 00:00:34,137 INFO [Listener at jenkins-hbase16.apache.org/38477] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/java.io.tmpdir/Jetty_jenkins.hbase16_apache_org_44333_node____fthxcu/webapp 2023-10-04 00:00:34,180 INFO [Listener at jenkins-hbase16.apache.org/38477] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-04 00:00:34,180 INFO [Listener at jenkins-hbase16.apache.org/38477] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 00:00:34,180 INFO [Listener at jenkins-hbase16.apache.org/38477] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 00:00:34,180 INFO [Listener at jenkins-hbase16.apache.org/38477] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 00:00:34,188 INFO [Listener at jenkins-hbase16.apache.org/38477] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:34,207 INFO [Listener at jenkins-hbase16.apache.org/38477] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:34,277 INFO [Listener at jenkins-hbase16.apache.org/38477] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:34,286 INFO [Listener at jenkins-hbase16.apache.org/38477] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:44333 2023-10-04 00:00:34,482 WARN [Listener at jenkins-hbase16.apache.org/38813] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 00:00:34,487 WARN [Listener at jenkins-hbase16.apache.org/38813] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 00:00:34,487 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 00:00:34,497 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/java.io.tmpdir/Jetty_jenkins.hbase16_apache_org_38615_node____su0mcg/webapp 2023-10-04 00:00:34,561 INFO [Listener at jenkins-hbase16.apache.org/38813] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-04 00:00:34,561 INFO [Listener at jenkins-hbase16.apache.org/38813] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 00:00:34,562 INFO [Listener at jenkins-hbase16.apache.org/38813] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 00:00:34,562 INFO [Listener at jenkins-hbase16.apache.org/38813] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 00:00:34,570 INFO [Listener at jenkins-hbase16.apache.org/38813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:34,588 INFO [Listener at jenkins-hbase16.apache.org/38813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:34,668 INFO [Listener at jenkins-hbase16.apache.org/38813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 00:00:34,673 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:38615 2023-10-04 00:00:34,697 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-04 00:00:34,699 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:00:34,761 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=710, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=199, ProcessCount=168, AvailableMemoryMB=5522 2023-10-04 00:00:34,761 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=710 is superior to 500 2023-10-04 00:00:34,772 DEBUG [Listener at jenkins-hbase16.apache.org/38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-04 00:00:34,777 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:60380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-04 00:00:34,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 00:00:34,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-04 00:00:34,788 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 00:00:34,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-04 00:00:34,792 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 00:00:34,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 00:00:34,797 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:34,797 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:34,801 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49 empty. 2023-10-04 00:00:34,801 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c empty. 2023-10-04 00:00:34,804 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:34,804 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:34,804 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-04 00:00:34,836 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-04 00:00:34,838 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => b1434f7d04b4aa54ab14b1f8d1d4889c, NAME => 'testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:00:34,838 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 14295ff01dde9d5cbfd98e7b96a86f49, NAME => 'testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:00:34,880 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:34,881 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing b1434f7d04b4aa54ab14b1f8d1d4889c, disabling compactions & flushes 2023-10-04 00:00:34,881 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:34,881 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:34,881 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. after waiting 0 ms 2023-10-04 00:00:34,882 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:34,882 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:34,882 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for b1434f7d04b4aa54ab14b1f8d1d4889c: 2023-10-04 00:00:34,882 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:34,883 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 14295ff01dde9d5cbfd98e7b96a86f49, disabling compactions & flushes 2023-10-04 00:00:34,883 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:34,883 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:34,883 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. after waiting 0 ms 2023-10-04 00:00:34,883 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:34,883 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:34,883 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 14295ff01dde9d5cbfd98e7b96a86f49: 2023-10-04 00:00:34,887 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 00:00:34,889 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696377634889"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377634889"}]},"ts":"1696377634889"} 2023-10-04 00:00:34,889 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696377634889"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377634889"}]},"ts":"1696377634889"} 2023-10-04 00:00:34,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 00:00:34,931 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 00:00:34,933 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 00:00:34,933 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377634933"}]},"ts":"1696377634933"} 2023-10-04 00:00:34,935 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-04 00:00:34,978 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-10-04 00:00:34,980 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 00:00:34,980 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 00:00:34,980 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 00:00:34,980 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 00:00:34,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1434f7d04b4aa54ab14b1f8d1d4889c, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14295ff01dde9d5cbfd98e7b96a86f49, ASSIGN}] 2023-10-04 00:00:34,982 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 00:00:34,984 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14295ff01dde9d5cbfd98e7b96a86f49, ASSIGN 2023-10-04 00:00:34,984 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1434f7d04b4aa54ab14b1f8d1d4889c, ASSIGN 2023-10-04 00:00:34,985 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1434f7d04b4aa54ab14b1f8d1d4889c, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,41265,1696377627379; forceNewPlan=false, retain=false 2023-10-04 00:00:34,985 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14295ff01dde9d5cbfd98e7b96a86f49, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,43449,1696377627431; forceNewPlan=false, retain=false 2023-10-04 00:00:35,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 00:00:35,124 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-04 00:00:35,126 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-04 00:00:35,127 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-04 00:00:35,135 INFO [jenkins-hbase16:34927] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 00:00:35,138 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b1434f7d04b4aa54ab14b1f8d1d4889c, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:35,138 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=14295ff01dde9d5cbfd98e7b96a86f49, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:35,138 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696377635138"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377635138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377635138"}]},"ts":"1696377635138"} 2023-10-04 00:00:35,138 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696377635138"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377635138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377635138"}]},"ts":"1696377635138"} 2023-10-04 00:00:35,141 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure b1434f7d04b4aa54ab14b1f8d1d4889c, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:00:35,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 14295ff01dde9d5cbfd98e7b96a86f49, server=jenkins-hbase16.apache.org,43449,1696377627431}] 2023-10-04 00:00:35,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:35,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1434f7d04b4aa54ab14b1f8d1d4889c, NAME => 'testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 00:00:35,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. service=AccessControlService 2023-10-04 00:00:35,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:35,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:35,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:35,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:35,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:35,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:35,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 14295ff01dde9d5cbfd98e7b96a86f49, NAME => 'testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 00:00:35,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. service=AccessControlService 2023-10-04 00:00:35,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:35,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:35,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:35,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:35,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:35,305 INFO [StoreOpener-b1434f7d04b4aa54ab14b1f8d1d4889c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:35,305 INFO [StoreOpener-14295ff01dde9d5cbfd98e7b96a86f49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:35,307 DEBUG [StoreOpener-14295ff01dde9d5cbfd98e7b96a86f49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/cf 2023-10-04 00:00:35,307 DEBUG [StoreOpener-14295ff01dde9d5cbfd98e7b96a86f49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/cf 2023-10-04 00:00:35,307 DEBUG [StoreOpener-b1434f7d04b4aa54ab14b1f8d1d4889c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/cf 2023-10-04 00:00:35,307 DEBUG [StoreOpener-b1434f7d04b4aa54ab14b1f8d1d4889c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/cf 2023-10-04 00:00:35,310 INFO [StoreOpener-14295ff01dde9d5cbfd98e7b96a86f49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14295ff01dde9d5cbfd98e7b96a86f49 columnFamilyName cf 2023-10-04 00:00:35,310 INFO [StoreOpener-b1434f7d04b4aa54ab14b1f8d1d4889c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1434f7d04b4aa54ab14b1f8d1d4889c columnFamilyName cf 2023-10-04 00:00:35,313 INFO [StoreOpener-b1434f7d04b4aa54ab14b1f8d1d4889c-1] regionserver.HStore(310): Store=b1434f7d04b4aa54ab14b1f8d1d4889c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:35,313 INFO [StoreOpener-14295ff01dde9d5cbfd98e7b96a86f49-1] regionserver.HStore(310): Store=14295ff01dde9d5cbfd98e7b96a86f49/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:35,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:35,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:35,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:35,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:35,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:35,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:35,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:00:35,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:00:35,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 14295ff01dde9d5cbfd98e7b96a86f49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69468086, jitterRate=0.035155147314071655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:00:35,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 14295ff01dde9d5cbfd98e7b96a86f49: 2023-10-04 00:00:35,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened b1434f7d04b4aa54ab14b1f8d1d4889c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63604067, jitterRate=-0.052225545048713684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:00:35,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for b1434f7d04b4aa54ab14b1f8d1d4889c: 2023-10-04 00:00:35,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c., pid=15, masterSystemTime=1696377635294 2023-10-04 00:00:35,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49., pid=16, masterSystemTime=1696377635295 2023-10-04 00:00:35,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:35,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:35,332 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b1434f7d04b4aa54ab14b1f8d1d4889c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:35,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:35,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:35,332 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696377635332"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377635332"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377635332"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377635332"}]},"ts":"1696377635332"} 2023-10-04 00:00:35,334 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=14295ff01dde9d5cbfd98e7b96a86f49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:35,334 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696377635334"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377635334"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377635334"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377635334"}]},"ts":"1696377635334"} 2023-10-04 00:00:35,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-04 00:00:35,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure b1434f7d04b4aa54ab14b1f8d1d4889c, server=jenkins-hbase16.apache.org,41265,1696377627379 in 194 msec 2023-10-04 00:00:35,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-04 00:00:35,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 14295ff01dde9d5cbfd98e7b96a86f49, server=jenkins-hbase16.apache.org,43449,1696377627431 in 195 msec 2023-10-04 00:00:35,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1434f7d04b4aa54ab14b1f8d1d4889c, ASSIGN in 361 msec 2023-10-04 00:00:35,351 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-04 00:00:35,351 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14295ff01dde9d5cbfd98e7b96a86f49, ASSIGN in 366 msec 2023-10-04 00:00:35,352 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 00:00:35,352 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377635352"}]},"ts":"1696377635352"} 2023-10-04 00:00:35,355 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-04 00:00:35,386 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 00:00:35,392 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-04 00:00:35,398 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:35,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 00:00:35,401 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:35,405 DEBUG [hconnection-0x3e733f02-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:35,408 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-10-04 00:00:35,415 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 00:00:35,451 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:35,451 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:35,451 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:35,451 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:35,452 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:00:35,474 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 00:00:35,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 00:00:35,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 00:00:35,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 00:00:35,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 00:00:35,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 692 msec 2023-10-04 00:00:35,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 00:00:35,901 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-04 00:00:35,905 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-04 00:00:35,906 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:35,908 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:00:35,937 DEBUG [hconnection-0x230246c-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:35,940 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:35,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 00:00:35,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377635960 (current time:1696377635960). 2023-10-04 00:00:35,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:00:35,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x5a8b8495 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:36,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e089632, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:36,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:36,008 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:36,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a8b8495 to 127.0.0.1:51489 2023-10-04 00:00:36,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:00:36,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x4a4c18d1 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:36,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e0c539d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:36,030 DEBUG [hconnection-0x7909e8b9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:36,031 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:36,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:36,038 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:36,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a4c18d1 to 127.0.0.1:51489 2023-10-04 00:00:36,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:00:36,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 00:00:36,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:00:36,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 00:00:36,074 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:00:36,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 00:00:36,097 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 00:00:36,098 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696378236098 2023-10-04 00:00:36,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 00:00:36,099 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-04 00:00:36,102 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 00:00:36,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 00:00:36,105 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:00:36,105 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:00:36,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-10-04 00:00:36,107 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 00:00:36,109 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696378236109 2023-10-04 00:00:36,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,135 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-04 00:00:36,135 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:36,136 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-04 00:00:36,136 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-04 00:00:36,137 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,137 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,160 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,160 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,160 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,160 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,161 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,161 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,162 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,162 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:00:36,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 00:00:36,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 00:00:36,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 00:00:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 00:00:36,168 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 00:00:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 00:00:36,168 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:36,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 00:00:36,170 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 00:00:36,170 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 00:00:36,170 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 00:00:36,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,170 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 00:00:36,171 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:36,171 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 00:00:36,171 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:36,171 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 00:00:36,172 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 00:00:36,172 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 00:00:36,172 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 00:00:36,172 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 00:00:36,172 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 00:00:36,185 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,193 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,193 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,193 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,193 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,193 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,193 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:36,194 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,194 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,194 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:36,194 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:36,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-04 00:00:36,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75184001[Count = 1] remaining members to acquire global barrier 2023-10-04 00:00:36,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:36,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:36,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:36,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:36,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:36,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-04 00:00:36,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75184001[Count = 0] remaining members to acquire global barrier 2023-10-04 00:00:36,199 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-04 00:00:36,199 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,206 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:00:36,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 00:00:36,210 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,210 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,210 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,210 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 00:00:36,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:00:36,210 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 00:00:36,210 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,210 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 00:00:36,210 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 00:00:36,211 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,211 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:00:36,210 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:00:36,211 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:00:36,211 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:00:36,211 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:00:36,211 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:00:36,211 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:36,211 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:36,211 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:00:36,212 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. started... 2023-10-04 00:00:36,212 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. started... 2023-10-04 00:00:36,215 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1434f7d04b4aa54ab14b1f8d1d4889c: 2023-10-04 00:00:36,215 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 14295ff01dde9d5cbfd98e7b96a86f49: 2023-10-04 00:00:36,216 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,216 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,219 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 00:00:36,220 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:36,220 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 00:00:36,225 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:00:36,225 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:00:36,228 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:00:36,228 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:00:36,255 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. completed. 2023-10-04 00:00:36,255 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:36,256 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:00:36,256 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:00:36,256 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,256 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 00:00:36,256 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:00:36,256 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. completed. 2023-10-04 00:00:36,256 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:36,256 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:00:36,256 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:00:36,256 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,257 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 00:00:36,257 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:00:36,267 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,267 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 00:00:36,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:36,267 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:36,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:36,267 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 00:00:36,276 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 00:00:36,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:36,277 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:36,276 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,277 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 00:00:36,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:36,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:36,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase16.apache.org,43449,1696377627431': 2023-10-04 00:00:36,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-04 00:00:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase16.apache.org,41265,1696377627379': 2023-10-04 00:00:36,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-04 00:00:36,288 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-04 00:00:36,288 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:00:36,288 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:00:36,288 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,288 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:00:36,299 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,299 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,299 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,299 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,299 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:36,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,300 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:36,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,300 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,300 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,301 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,301 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,303 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,303 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:36,304 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,327 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,327 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,327 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,327 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,327 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:36,327 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,327 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,327 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,329 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,329 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,327 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,329 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,329 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-04 00:00:36,329 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,329 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:00:36,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,330 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,330 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,330 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,330 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,330 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 00:00:36,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,387 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:00:36,388 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-04 00:00:36,389 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:00:36,389 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-04 00:00:36,390 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-04 00:00:36,390 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-04 00:00:36,390 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:00:36,390 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-04 00:00:36,390 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-04 00:00:36,391 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-04 00:00:36,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-04 00:00:36,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,411 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:00:36,411 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:36,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696377636099Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696377636350 (+251 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696377636350Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696377636350Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696377636364 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696377636396 (+32 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696377636410 (+14 ms) 2023-10-04 00:00:36,414 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 00:00:36,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 00:00:36,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:00:36,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 314 msec 2023-10-04 00:00:36,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41265] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:00:36,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43449] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:00:36,439 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-04 00:00:36,439 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:36,439 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:00:36,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 00:00:36,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377636457 (current time:1696377636457). 2023-10-04 00:00:36,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:00:36,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x245aa974 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:36,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a997b2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:36,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:36,473 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:36,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x245aa974 to 127.0.0.1:51489 2023-10-04 00:00:36,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:00:36,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x357afdfd to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:36,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@441ae32f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:36,496 DEBUG [hconnection-0x657bb892-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:36,498 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:40846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:36,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:36,506 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:49960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:36,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x357afdfd to 127.0.0.1:51489 2023-10-04 00:00:36,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:00:36,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 00:00:36,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:00:36,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 00:00:36,512 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:00:36,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 00:00:36,516 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 00:00:36,517 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696378236517 2023-10-04 00:00:36,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 00:00:36,517 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-04 00:00:36,519 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:00:36,519 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:00:36,521 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 00:00:36,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 00:00:36,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-10-04 00:00:36,524 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 00:00:36,525 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696378236525 2023-10-04 00:00:36,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-04 00:00:36,543 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-04 00:00:36,543 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:36,544 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-04 00:00:36,544 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-04 00:00:36,545 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,545 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,551 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,551 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,551 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,551 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,552 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,552 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,553 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,553 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,553 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 00:00:36,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 00:00:36,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 00:00:36,554 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 00:00:36,554 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:36,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 00:00:36,555 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 00:00:36,555 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 00:00:36,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 00:00:36,555 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:36,555 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 00:00:36,556 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 00:00:36,556 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 00:00:36,556 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 00:00:36,555 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 00:00:36,556 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:36,556 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 00:00:36,557 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 00:00:36,557 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 00:00:36,557 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 00:00:36,568 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,568 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:36,576 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:36,576 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,577 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:36,576 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,576 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,577 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:36,577 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:36,577 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,577 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:36,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 00:00:36,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:36,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-04 00:00:36,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24b2af7b[Count = 1] remaining members to acquire global barrier 2023-10-04 00:00:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 00:00:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:36,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-04 00:00:36,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24b2af7b[Count = 0] remaining members to acquire global barrier 2023-10-04 00:00:36,581 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-04 00:00:36,581 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,619 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:00:36,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 00:00:36,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:00:36,621 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:00:36,629 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,629 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,629 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,630 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,629 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 00:00:36,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,630 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 00:00:36,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,630 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:00:36,630 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 00:00:36,630 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:00:36,630 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:36,630 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 00:00:36,630 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. started... 2023-10-04 00:00:36,630 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:36,630 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,630 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:00:36,630 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:00:36,630 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. started... 2023-10-04 00:00:36,630 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 14295ff01dde9d5cbfd98e7b96a86f49 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-04 00:00:36,630 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:00:36,630 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:00:36,631 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b1434f7d04b4aa54ab14b1f8d1d4889c 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-04 00:00:36,650 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 00:00:36,650 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:36,651 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 00:00:36,768 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100455c43d183a184a58ae73bc406f912be6 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100455c43d183a184a58ae73bc406f912be6 2023-10-04 00:00:36,768 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004459314aa8e68494a9df6583f3567ddcb to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004459314aa8e68494a9df6583f3567ddcb 2023-10-04 00:00:36,796 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/.tmp/cf/d5cf1a0c44434a91ad137799ef360557 2023-10-04 00:00:36,797 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/.tmp/cf/6aa7413ad1b141cfa523139cc8122752 2023-10-04 00:00:36,807 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/.tmp/cf/d5cf1a0c44434a91ad137799ef360557 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/cf/d5cf1a0c44434a91ad137799ef360557 2023-10-04 00:00:36,807 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/.tmp/cf/6aa7413ad1b141cfa523139cc8122752 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/cf/6aa7413ad1b141cfa523139cc8122752 2023-10-04 00:00:36,816 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/cf/d5cf1a0c44434a91ad137799ef360557, entries=5, sequenceid=6, filesize=5.7 K 2023-10-04 00:00:36,816 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/cf/6aa7413ad1b141cfa523139cc8122752, entries=45, sequenceid=6, filesize=12.5 K 2023-10-04 00:00:36,820 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for b1434f7d04b4aa54ab14b1f8d1d4889c in 189ms, sequenceid=6, compaction requested=false 2023-10-04 00:00:36,820 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 14295ff01dde9d5cbfd98e7b96a86f49 in 190ms, sequenceid=6, compaction requested=false 2023-10-04 00:00:36,820 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-04 00:00:36,820 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-04 00:00:36,822 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:00:36,823 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 14295ff01dde9d5cbfd98e7b96a86f49: 2023-10-04 00:00:36,823 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1434f7d04b4aa54ab14b1f8d1d4889c: 2023-10-04 00:00:36,823 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 00:00:36,823 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 00:00:36,823 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:00:36,823 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:00:36,823 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/cf/6aa7413ad1b141cfa523139cc8122752] hfiles 2023-10-04 00:00:36,823 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/cf/d5cf1a0c44434a91ad137799ef360557] hfiles 2023-10-04 00:00:36,824 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/cf/6aa7413ad1b141cfa523139cc8122752 for snapshot=snaptb0-testExportWithTargetName 2023-10-04 00:00:36,824 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/cf/d5cf1a0c44434a91ad137799ef360557 for snapshot=snaptb0-testExportWithTargetName 2023-10-04 00:00:36,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 00:00:36,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:00:36,824 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-04 00:00:36,847 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. completed. 2023-10-04 00:00:36,847 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:36,847 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:00:36,847 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:00:36,847 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,847 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 00:00:36,847 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:00:36,848 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. completed. 2023-10-04 00:00:36,848 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:36,848 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:00:36,848 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:00:36,848 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,848 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 00:00:36,848 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:00:36,858 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 00:00:36,858 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,858 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:36,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:36,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:36,858 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 00:00:36,868 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 00:00:36,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:36,868 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,868 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:36,868 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 00:00:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 00:00:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:36,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 00:00:36,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase16.apache.org,43449,1696377627431': 2023-10-04 00:00:36,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-04 00:00:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 00:00:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 00:00:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase16.apache.org,41265,1696377627379': 2023-10-04 00:00:36,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-04 00:00:36,877 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-04 00:00:36,877 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:00:36,877 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:00:36,877 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-04 00:00:36,877 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:00:36,885 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,885 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,885 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,885 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,885 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,885 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:36,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:36,885 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:36,886 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 00:00:36,886 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:36,887 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 00:00:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,888 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:36,889 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 00:00:36,889 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-04 00:00:36,908 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:36,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:36,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,909 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:36,910 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,910 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:36,910 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:36,910 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,910 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-04 00:00:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:36,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 00:00:36,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:00:36,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:36,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:36,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100455c43d183a184a58ae73bc406f912be6, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004459314aa8e68494a9df6583f3567ddcb] mob files 2023-10-04 00:00:36,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100455c43d183a184a58ae73bc406f912be6 2023-10-04 00:00:36,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004459314aa8e68494a9df6583f3567ddcb 2023-10-04 00:00:36,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-04 00:00:36,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-04 00:00:36,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,966 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 00:00:36,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696377636518Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696377636928 (+410 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696377636928Loading Region manifests for snaptb0-testExportWithTargetName at 1696377636928Writing data manifest for snaptb0-testExportWithTargetName at 1696377636932 (+4 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696377636954 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696377636965 (+11 ms) 2023-10-04 00:00:36,968 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 00:00:36,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 449 msec 2023-10-04 00:00:37,124 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:00:37,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 00:00:37,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:00:37,128 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377637128 2023-10-04 00:00:37,128 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43845, tgtDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377637128, rawTgtDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377637128, srcFsUri=hdfs://localhost:43845, srcDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:00:37,176 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:00:37,176 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1531886957_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377637128, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377637128/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-04 00:00:37,176 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d, snapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-04 00:00:37,196 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377637128/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-04 00:00:37,653 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:37,653 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:37,654 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:37,654 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:38,408 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-3509344271566550895.jar 2023-10-04 00:00:38,409 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:38,409 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:38,466 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-8759522768309819935.jar 2023-10-04 00:00:38,466 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:38,467 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:38,467 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:38,468 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:38,469 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:38,469 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:38,469 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 00:00:38,470 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 00:00:38,471 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 00:00:38,471 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 00:00:38,471 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 00:00:38,472 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 00:00:38,472 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 00:00:38,473 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 00:00:38,473 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 00:00:38,474 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 00:00:38,477 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:00:38,478 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:00:38,478 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:00:38,478 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:00:38,478 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:00:38,479 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:00:38,480 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:00:39,262 WARN [Listener at jenkins-hbase16.apache.org/38813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 00:00:39,268 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-04 00:00:39,276 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-04 00:00:39,640 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:00:39,642 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:00:39,832 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0001_000001 (auth:SIMPLE) 2023-10-04 00:00:40,807 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 00:00:43,595 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0001_000001 (auth:SIMPLE) 2023-10-04 00:00:45,821 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0001_000001 (auth:SIMPLE) 2023-10-04 00:00:48,135 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0001_000001 (auth:SIMPLE) 2023-10-04 00:00:50,048 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 00:00:50,052 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 00:00:50,062 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-04 00:00:50,062 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 00:00:50,063 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 00:00:50,063 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-04 00:00:50,064 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-04 00:00:50,064 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-04 00:00:50,064 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377637128/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377637128/.hbase-snapshot/testExportWithTargetName 2023-10-04 00:00:50,065 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377637128/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-04 00:00:50,065 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377637128/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-04 00:00:50,076 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-04 00:00:50,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testExportWithTargetName 2023-10-04 00:00:50,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-04 00:00:50,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377650095"}]},"ts":"1696377650095"} 2023-10-04 00:00:50,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 00:00:50,098 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-04 00:00:50,134 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-04 00:00:50,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1434f7d04b4aa54ab14b1f8d1d4889c, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14295ff01dde9d5cbfd98e7b96a86f49, UNASSIGN}] 2023-10-04 00:00:50,139 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14295ff01dde9d5cbfd98e7b96a86f49, UNASSIGN 2023-10-04 00:00:50,139 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1434f7d04b4aa54ab14b1f8d1d4889c, UNASSIGN 2023-10-04 00:00:50,140 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=14295ff01dde9d5cbfd98e7b96a86f49, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:50,140 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b1434f7d04b4aa54ab14b1f8d1d4889c, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:50,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696377650140"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377650140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377650140"}]},"ts":"1696377650140"} 2023-10-04 00:00:50,140 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696377650140"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377650140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377650140"}]},"ts":"1696377650140"} 2023-10-04 00:00:50,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 14295ff01dde9d5cbfd98e7b96a86f49, server=jenkins-hbase16.apache.org,43449,1696377627431}] 2023-10-04 00:00:50,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure b1434f7d04b4aa54ab14b1f8d1d4889c, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:00:50,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 00:00:50,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:50,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:50,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing b1434f7d04b4aa54ab14b1f8d1d4889c, disabling compactions & flushes 2023-10-04 00:00:50,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 14295ff01dde9d5cbfd98e7b96a86f49, disabling compactions & flushes 2023-10-04 00:00:50,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:50,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:50,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:50,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. after waiting 0 ms 2023-10-04 00:00:50,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:50,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:50,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. after waiting 0 ms 2023-10-04 00:00:50,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:50,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:00:50,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:00:50,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:00:50,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:00:50,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49. 2023-10-04 00:00:50,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c. 2023-10-04 00:00:50,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 14295ff01dde9d5cbfd98e7b96a86f49: 2023-10-04 00:00:50,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for b1434f7d04b4aa54ab14b1f8d1d4889c: 2023-10-04 00:00:50,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:50,329 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=14295ff01dde9d5cbfd98e7b96a86f49, regionState=CLOSED 2023-10-04 00:00:50,329 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696377650329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377650329"}]},"ts":"1696377650329"} 2023-10-04 00:00:50,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:50,330 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b1434f7d04b4aa54ab14b1f8d1d4889c, regionState=CLOSED 2023-10-04 00:00:50,330 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696377650330"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377650330"}]},"ts":"1696377650330"} 2023-10-04 00:00:50,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-04 00:00:50,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 14295ff01dde9d5cbfd98e7b96a86f49, server=jenkins-hbase16.apache.org,43449,1696377627431 in 189 msec 2023-10-04 00:00:50,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-10-04 00:00:50,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure b1434f7d04b4aa54ab14b1f8d1d4889c, server=jenkins-hbase16.apache.org,41265,1696377627379 in 189 msec 2023-10-04 00:00:50,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=14295ff01dde9d5cbfd98e7b96a86f49, UNASSIGN in 197 msec 2023-10-04 00:00:50,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-04 00:00:50,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1434f7d04b4aa54ab14b1f8d1d4889c, UNASSIGN in 199 msec 2023-10-04 00:00:50,341 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377650341"}]},"ts":"1696377650341"} 2023-10-04 00:00:50,343 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-04 00:00:50,351 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-04 00:00:50,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 268 msec 2023-10-04 00:00:50,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 00:00:50,399 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-04 00:00:50,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testExportWithTargetName 2023-10-04 00:00:50,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 00:00:50,414 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 00:00:50,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-04 00:00:50,416 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 00:00:50,419 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-04 00:00:50,422 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:50,422 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:50,425 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/recovered.edits] 2023-10-04 00:00:50,425 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/recovered.edits] 2023-10-04 00:00:50,432 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/cf/d5cf1a0c44434a91ad137799ef360557 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/cf/d5cf1a0c44434a91ad137799ef360557 2023-10-04 00:00:50,433 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/cf/6aa7413ad1b141cfa523139cc8122752 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/cf/6aa7413ad1b141cfa523139cc8122752 2023-10-04 00:00:50,436 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49/recovered.edits/9.seqid 2023-10-04 00:00:50,436 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c/recovered.edits/9.seqid 2023-10-04 00:00:50,437 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/14295ff01dde9d5cbfd98e7b96a86f49 2023-10-04 00:00:50,437 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportWithTargetName/b1434f7d04b4aa54ab14b1f8d1d4889c 2023-10-04 00:00:50,437 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-04 00:00:50,438 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-04 00:00:50,439 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-04 00:00:50,443 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100455c43d183a184a58ae73bc406f912be6 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023100455c43d183a184a58ae73bc406f912be6 2023-10-04 00:00:50,444 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004459314aa8e68494a9df6583f3567ddcb to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231004459314aa8e68494a9df6583f3567ddcb 2023-10-04 00:00:50,445 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-04 00:00:50,448 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 00:00:50,466 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-04 00:00:50,469 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-04 00:00:50,471 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 00:00:50,471 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-04 00:00:50,471 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377650471"}]},"ts":"9223372036854775807"} 2023-10-04 00:00:50,471 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377650471"}]},"ts":"9223372036854775807"} 2023-10-04 00:00:50,474 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 00:00:50,474 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b1434f7d04b4aa54ab14b1f8d1d4889c, NAME => 'testtb-testExportWithTargetName,,1696377634782.b1434f7d04b4aa54ab14b1f8d1d4889c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 14295ff01dde9d5cbfd98e7b96a86f49, NAME => 'testtb-testExportWithTargetName,1,1696377634782.14295ff01dde9d5cbfd98e7b96a86f49.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 00:00:50,474 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-04 00:00:50,475 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696377650474"}]},"ts":"9223372036854775807"} 2023-10-04 00:00:50,477 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-04 00:00:50,663 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 00:00:50,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 258 msec 2023-10-04 00:00:50,755 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 00:00:50,755 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 00:00:50,755 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 00:00:50,755 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 00:00:50,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-04 00:00:50,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-04 00:00:50,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-04 00:00:50,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-04 00:00:50,815 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 00:00:50,815 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 00:00:50,815 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 00:00:50,815 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 00:00:50,816 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:50,816 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:50,816 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:50,816 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:50,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-04 00:00:50,819 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-04 00:00:50,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-04 00:00:50,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-04 00:00:50,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testExportWithTargetName" 2023-10-04 00:00:50,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-04 00:00:50,873 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=757 (was 710) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1846971054_1 at /127.0.0.1:52530 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase16.apache.org/188.40.62.62:40023 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase16.apache.org/188.40.62.62:38813 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase16.apache.org/188.40.62.62:44901 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_955129651_17 at /127.0.0.1:36226 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_955129651_17 at /127.0.0.1:40532 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_955129651_17 at /127.0.0.1:52560 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1846971054_1 at /127.0.0.1:36204 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=290 (was 199) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=4727 (was 5522) 2023-10-04 00:00:50,873 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-10-04 00:00:50,890 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=290, ProcessCount=171, AvailableMemoryMB=4726 2023-10-04 00:00:50,890 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-10-04 00:00:50,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 00:00:50,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-04 00:00:50,898 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 00:00:50,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-04 00:00:50,901 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 00:00:50,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 00:00:50,904 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12 2023-10-04 00:00:50,904 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:00:50,905 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12 empty. 2023-10-04 00:00:50,905 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a empty. 2023-10-04 00:00:50,905 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12 2023-10-04 00:00:50,905 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:00:50,906 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-04 00:00:50,918 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-04 00:00:50,920 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cf4dee129a525ec9cd371eea26342d5a, NAME => 'testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:00:50,920 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 429f9b6536781416a61c170270c51c12, NAME => 'testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:00:50,947 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:50,947 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:50,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 429f9b6536781416a61c170270c51c12, disabling compactions & flushes 2023-10-04 00:00:50,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cf4dee129a525ec9cd371eea26342d5a, disabling compactions & flushes 2023-10-04 00:00:50,949 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:50,949 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:50,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:50,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:50,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. after waiting 0 ms 2023-10-04 00:00:50,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. after waiting 0 ms 2023-10-04 00:00:50,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:50,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:50,949 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:50,949 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:50,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 429f9b6536781416a61c170270c51c12: 2023-10-04 00:00:50,949 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cf4dee129a525ec9cd371eea26342d5a: 2023-10-04 00:00:50,952 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 00:00:50,953 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696377650953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377650953"}]},"ts":"1696377650953"} 2023-10-04 00:00:50,953 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696377650953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377650953"}]},"ts":"1696377650953"} 2023-10-04 00:00:50,956 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 00:00:50,957 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 00:00:50,957 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377650957"}]},"ts":"1696377650957"} 2023-10-04 00:00:50,958 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-04 00:00:51,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 00:00:51,034 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-10-04 00:00:51,036 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 00:00:51,036 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 00:00:51,036 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 00:00:51,036 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 00:00:51,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=429f9b6536781416a61c170270c51c12, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf4dee129a525ec9cd371eea26342d5a, ASSIGN}] 2023-10-04 00:00:51,039 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf4dee129a525ec9cd371eea26342d5a, ASSIGN 2023-10-04 00:00:51,039 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=429f9b6536781416a61c170270c51c12, ASSIGN 2023-10-04 00:00:51,040 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf4dee129a525ec9cd371eea26342d5a, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,44307,1696377627472; forceNewPlan=false, retain=false 2023-10-04 00:00:51,040 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=429f9b6536781416a61c170270c51c12, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,43449,1696377627431; forceNewPlan=false, retain=false 2023-10-04 00:00:51,191 INFO [jenkins-hbase16:34927] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 00:00:51,194 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cf4dee129a525ec9cd371eea26342d5a, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,194 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=429f9b6536781416a61c170270c51c12, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,194 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696377651193"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377651193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377651193"}]},"ts":"1696377651193"} 2023-10-04 00:00:51,194 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696377651193"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377651193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377651193"}]},"ts":"1696377651193"} 2023-10-04 00:00:51,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure cf4dee129a525ec9cd371eea26342d5a, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:00:51,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 429f9b6536781416a61c170270c51c12, server=jenkins-hbase16.apache.org,43449,1696377627431}] 2023-10-04 00:00:51,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 00:00:51,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:51,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:51,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf4dee129a525ec9cd371eea26342d5a, NAME => 'testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 00:00:51,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 429f9b6536781416a61c170270c51c12, NAME => 'testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 00:00:51,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. service=AccessControlService 2023-10-04 00:00:51,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:51,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:00:51,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. service=AccessControlService 2023-10-04 00:00:51,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:51,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:00:51,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:00:51,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 429f9b6536781416a61c170270c51c12 2023-10-04 00:00:51,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:00:51,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:00:51,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 429f9b6536781416a61c170270c51c12 2023-10-04 00:00:51,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 429f9b6536781416a61c170270c51c12 2023-10-04 00:00:51,363 INFO [StoreOpener-429f9b6536781416a61c170270c51c12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 429f9b6536781416a61c170270c51c12 2023-10-04 00:00:51,363 INFO [StoreOpener-cf4dee129a525ec9cd371eea26342d5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:00:51,364 DEBUG [StoreOpener-cf4dee129a525ec9cd371eea26342d5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/cf 2023-10-04 00:00:51,364 DEBUG [StoreOpener-429f9b6536781416a61c170270c51c12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/cf 2023-10-04 00:00:51,364 DEBUG [StoreOpener-429f9b6536781416a61c170270c51c12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/cf 2023-10-04 00:00:51,364 DEBUG [StoreOpener-cf4dee129a525ec9cd371eea26342d5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/cf 2023-10-04 00:00:51,365 INFO [StoreOpener-cf4dee129a525ec9cd371eea26342d5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf4dee129a525ec9cd371eea26342d5a columnFamilyName cf 2023-10-04 00:00:51,365 INFO [StoreOpener-429f9b6536781416a61c170270c51c12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 429f9b6536781416a61c170270c51c12 columnFamilyName cf 2023-10-04 00:00:51,366 INFO [StoreOpener-cf4dee129a525ec9cd371eea26342d5a-1] regionserver.HStore(310): Store=cf4dee129a525ec9cd371eea26342d5a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:51,366 INFO [StoreOpener-429f9b6536781416a61c170270c51c12-1] regionserver.HStore(310): Store=429f9b6536781416a61c170270c51c12/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:00:51,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12 2023-10-04 00:00:51,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:00:51,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12 2023-10-04 00:00:51,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:00:51,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 429f9b6536781416a61c170270c51c12 2023-10-04 00:00:51,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:00:51,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:00:51,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:00:51,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened cf4dee129a525ec9cd371eea26342d5a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60682980, jitterRate=-0.09575313329696655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:00:51,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 429f9b6536781416a61c170270c51c12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67009458, jitterRate=-0.0014812648296356201}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:00:51,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for cf4dee129a525ec9cd371eea26342d5a: 2023-10-04 00:00:51,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 429f9b6536781416a61c170270c51c12: 2023-10-04 00:00:51,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a., pid=30, masterSystemTime=1696377651348 2023-10-04 00:00:51,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12., pid=31, masterSystemTime=1696377651351 2023-10-04 00:00:51,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:51,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:51,379 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=cf4dee129a525ec9cd371eea26342d5a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:51,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:51,379 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696377651379"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377651379"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377651379"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377651379"}]},"ts":"1696377651379"} 2023-10-04 00:00:51,380 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=429f9b6536781416a61c170270c51c12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,380 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696377651380"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377651380"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377651380"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377651380"}]},"ts":"1696377651380"} 2023-10-04 00:00:51,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-04 00:00:51,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure cf4dee129a525ec9cd371eea26342d5a, server=jenkins-hbase16.apache.org,44307,1696377627472 in 185 msec 2023-10-04 00:00:51,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-04 00:00:51,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 429f9b6536781416a61c170270c51c12, server=jenkins-hbase16.apache.org,43449,1696377627431 in 185 msec 2023-10-04 00:00:51,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf4dee129a525ec9cd371eea26342d5a, ASSIGN in 348 msec 2023-10-04 00:00:51,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-04 00:00:51,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=429f9b6536781416a61c170270c51c12, ASSIGN in 351 msec 2023-10-04 00:00:51,392 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 00:00:51,392 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377651392"}]},"ts":"1696377651392"} 2023-10-04 00:00:51,395 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-04 00:00:51,427 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 00:00:51,427 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-04 00:00:51,429 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 00:00:51,434 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:51,434 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:51,434 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:51,434 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:00:51,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 00:00:51,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 00:00:51,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 00:00:51,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 00:00:51,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 550 msec 2023-10-04 00:00:51,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 00:00:51,505 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-04 00:00:51,509 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-04 00:00:51,509 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:51,512 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:00:51,526 DEBUG [hconnection-0x230246c-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:51,532 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:51,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:00:51,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377651538 (current time:1696377651538). 2023-10-04 00:00:51,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:00:51,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x18ac809e to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:51,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15ed14fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:51,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:51,555 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:51,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18ac809e to 127.0.0.1:51489 2023-10-04 00:00:51,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:00:51,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x5f38d557 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:51,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23ec165e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:51,577 DEBUG [hconnection-0x5e5b8414-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:51,581 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:51,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:51,588 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:51,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f38d557 to 127.0.0.1:51489 2023-10-04 00:00:51,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:00:51,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 00:00:51,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:00:51,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:00:51,606 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:00:51,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:00:51,610 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:00:51,611 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696378251611 2023-10-04 00:00:51,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-04 00:00:51,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:00:51,614 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:00:51,614 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:00:51,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 00:00:51,616 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:00:51,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-10-04 00:00:51,621 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 00:00:51,622 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696378251622 2023-10-04 00:00:51,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,647 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-04 00:00:51,647 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:51,649 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-04 00:00:51,649 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-04 00:00:51,649 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,649 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,668 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,668 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:51,668 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:51,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:51,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:51,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:51,668 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:51,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:51,668 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:51,668 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:51,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,669 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,669 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:00:51,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 00:00:51,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,670 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 00:00:51,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 00:00:51,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,670 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 00:00:51,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,670 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 00:00:51,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 00:00:51,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,670 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:51,670 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 00:00:51,672 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 00:00:51,672 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 00:00:51,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,672 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 00:00:51,672 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:51,672 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 00:00:51,674 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 00:00:51,674 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 00:00:51,674 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 00:00:51,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,674 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 00:00:51,674 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:51,676 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 00:00:51,676 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 00:00:51,676 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 00:00:51,700 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,700 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,700 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:51,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:51,700 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,700 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:51,709 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,709 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,709 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:51,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:51,709 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,710 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,710 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:51,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:51,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:51,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-04 00:00:51,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2013b62b[Count = 1] remaining members to acquire global barrier 2023-10-04 00:00:51,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:51,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:51,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:51,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:51,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-04 00:00:51,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2013b62b[Count = 0] remaining members to acquire global barrier 2023-10-04 00:00:51,714 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:00:51,714 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 00:00:51,714 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 00:00:51,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:00:51,715 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:00:51,724 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,724 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,724 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,724 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:00:51,724 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,725 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:00:51,725 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:00:51,725 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:00:51,725 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:00:51,725 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 00:00:51,725 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:51,725 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:00:51,725 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. started... 2023-10-04 00:00:51,725 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:00:51,725 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:51,727 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. started... 2023-10-04 00:00:51,728 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,728 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:00:51,728 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf4dee129a525ec9cd371eea26342d5a: 2023-10-04 00:00:51,728 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,728 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:00:51,728 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:00:51,725 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:00:51,728 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 429f9b6536781416a61c170270c51c12: 2023-10-04 00:00:51,729 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,729 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:00:51,729 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:00:51,740 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 00:00:51,740 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:51,741 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 00:00:51,757 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. completed. 2023-10-04 00:00:51,757 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:51,757 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:00:51,757 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:00:51,757 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,757 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 00:00:51,757 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:00:51,761 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. completed. 2023-10-04 00:00:51,761 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:51,761 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:00:51,761 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:00:51,761 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,761 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 00:00:51,761 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:00:51,767 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 00:00:51,767 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:51,768 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:51,769 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 00:00:51,776 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 00:00:51,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:51,776 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:51,776 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,776 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 00:00:51,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:51,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase16.apache.org,44307,1696377627472': 2023-10-04 00:00:51,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 00:00:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:51,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:51,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase16.apache.org,43449,1696377627431': 2023-10-04 00:00:51,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 00:00:51,785 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-04 00:00:51,785 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:00:51,785 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:00:51,785 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,785 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:00:51,792 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:51,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:51,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:51,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:51,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:51,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:51,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:51,794 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:51,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,795 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,796 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:51,798 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,798 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,799 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,809 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:51,809 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:51,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:51,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:51,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:51,810 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,810 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,809 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:51,810 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:51,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:51,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:51,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-04 00:00:51,810 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:51,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:51,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,810 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:51,810 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,810 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:51,812 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,812 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,812 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:51,812 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,812 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:51,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:51,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:00:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:51,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:51,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:51,812 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:51,813 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,813 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 00:00:51,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-04 00:00:51,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,864 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 00:00:51,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696377651612Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696377651830 (+218 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696377651830Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696377651830Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696377651837 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696377651852 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696377651863 (+11 ms) 2023-10-04 00:00:51,866 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 00:00:51,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 253 msec 2023-10-04 00:00:51,916 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:00:51,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 00:00:51,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:00:51,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43449] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:00:51,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44307] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:00:51,931 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-04 00:00:51,931 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:51,931 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:00:51,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:00:51,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377651946 (current time:1696377651946). 2023-10-04 00:00:51,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:00:51,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x57d69d01 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:51,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ddd65f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:51,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:51,965 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:51,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57d69d01 to 127.0.0.1:51489 2023-10-04 00:00:51,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:00:51,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x035ac0f3 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:00:51,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76634826, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:00:51,987 DEBUG [hconnection-0x7706a2ac-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:51,988 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:51,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:00:51,996 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:00:51,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x035ac0f3 to 127.0.0.1:51489 2023-10-04 00:00:51,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:00:51,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 00:00:51,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:00:51,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:00:52,002 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:00:52,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:00:52,005 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:00:52,006 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696378252006 2023-10-04 00:00:52,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-04 00:00:52,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:00:52,007 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:00:52,008 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:00:52,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 00:00:52,009 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:00:52,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-04 00:00:52,012 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 00:00:52,014 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696378252014 2023-10-04 00:00:52,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-04 00:00:52,027 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-04 00:00:52,027 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:52,028 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-04 00:00:52,028 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-04 00:00:52,028 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,028 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,034 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:52,034 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,034 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:52,034 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:52,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:52,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:52,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:52,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:52,034 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,035 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,035 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,035 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:00:52,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 00:00:52,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 00:00:52,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 00:00:52,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 00:00:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 00:00:52,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 00:00:52,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 00:00:52,036 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 00:00:52,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 00:00:52,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 00:00:52,036 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 00:00:52,036 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 00:00:52,036 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:52,036 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:52,038 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 00:00:52,038 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 00:00:52,038 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 00:00:52,036 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:00:52,038 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 00:00:52,038 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 00:00:52,039 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 00:00:52,039 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 00:00:52,039 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 00:00:52,039 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 00:00:52,049 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,049 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:52,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:52,057 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,057 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,057 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,057 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,057 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:52,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:52,058 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,058 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:52,058 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,058 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:00:52,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:52,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 00:00:52,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:52,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-04 00:00:52,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@173ce260[Count = 1] remaining members to acquire global barrier 2023-10-04 00:00:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:52,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:52,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:52,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 00:00:52,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:52,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-04 00:00:52,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@173ce260[Count = 0] remaining members to acquire global barrier 2023-10-04 00:00:52,062 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 00:00:52,062 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,067 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,067 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,067 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,068 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,068 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:00:52,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,068 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:00:52,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,068 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:00:52,068 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:52,068 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,068 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:00:52,068 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 00:00:52,068 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. started... 2023-10-04 00:00:52,068 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:00:52,068 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:00:52,068 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:00:52,068 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 429f9b6536781416a61c170270c51c12 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-04 00:00:52,068 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:00:52,068 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:00:52,069 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:52,069 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. started... 2023-10-04 00:00:52,069 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cf4dee129a525ec9cd371eea26342d5a 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-04 00:00:52,076 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 00:00:52,076 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:52,076 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 00:00:52,100 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310048cdc9c70ee8246748498f65b2384a9a6 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310048cdc9c70ee8246748498f65b2384a9a6 2023-10-04 00:00:52,102 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100450c5597ec4ff4302aeae24c4732e21ea to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100450c5597ec4ff4302aeae24c4732e21ea 2023-10-04 00:00:52,108 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:00:52,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 00:00:52,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:00:52,109 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:00:52,110 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/.tmp/cf/d74c02da7ff048ba9980f2e1b508ca1d 2023-10-04 00:00:52,112 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/.tmp/cf/11c32b62537640d7bc0179c17316bbe1 2023-10-04 00:00:52,116 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/.tmp/cf/d74c02da7ff048ba9980f2e1b508ca1d as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/cf/d74c02da7ff048ba9980f2e1b508ca1d 2023-10-04 00:00:52,118 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/.tmp/cf/11c32b62537640d7bc0179c17316bbe1 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/cf/11c32b62537640d7bc0179c17316bbe1 2023-10-04 00:00:52,122 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/cf/d74c02da7ff048ba9980f2e1b508ca1d, entries=4, sequenceid=6, filesize=5.6 K 2023-10-04 00:00:52,123 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 429f9b6536781416a61c170270c51c12 in 55ms, sequenceid=6, compaction requested=false 2023-10-04 00:00:52,123 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-04 00:00:52,124 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 429f9b6536781416a61c170270c51c12: 2023-10-04 00:00:52,124 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 00:00:52,124 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:00:52,124 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/cf/d74c02da7ff048ba9980f2e1b508ca1d] hfiles 2023-10-04 00:00:52,124 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/cf/d74c02da7ff048ba9980f2e1b508ca1d for snapshot=snaptb0-testExportFileSystemState 2023-10-04 00:00:52,125 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/cf/11c32b62537640d7bc0179c17316bbe1, entries=46, sequenceid=6, filesize=12.7 K 2023-10-04 00:00:52,128 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for cf4dee129a525ec9cd371eea26342d5a in 59ms, sequenceid=6, compaction requested=false 2023-10-04 00:00:52,130 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf4dee129a525ec9cd371eea26342d5a: 2023-10-04 00:00:52,130 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 00:00:52,130 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:00:52,130 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/cf/11c32b62537640d7bc0179c17316bbe1] hfiles 2023-10-04 00:00:52,130 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/cf/11c32b62537640d7bc0179c17316bbe1 for snapshot=snaptb0-testExportFileSystemState 2023-10-04 00:00:52,137 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. completed. 2023-10-04 00:00:52,138 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:00:52,138 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:00:52,138 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:00:52,138 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,138 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 00:00:52,138 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:00:52,146 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. completed. 2023-10-04 00:00:52,146 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:00:52,146 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:00:52,146 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:00:52,146 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,146 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 00:00:52,146 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:00:52,166 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 00:00:52,166 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,166 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:52,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:52,166 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 00:00:52,176 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 00:00:52,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:52,176 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:52,176 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,176 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 00:00:52,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:52,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 00:00:52,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:52,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 00:00:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase16.apache.org,43449,1696377627431': 2023-10-04 00:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 00:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:52,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:52,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 00:00:52,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:52,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 00:00:52,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase16.apache.org,44307,1696377627472': 2023-10-04 00:00:52,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 00:00:52,185 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-04 00:00:52,185 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:00:52,185 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:00:52,185 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-04 00:00:52,185 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:00:52,192 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,192 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,192 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,192 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:52,192 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,192 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:00:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:00:52,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,193 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,192 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:52,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:00:52,193 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:52,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 00:00:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,194 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:00:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 00:00:52,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:00:52,196 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 00:00:52,196 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,196 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,207 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:52,207 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:52,207 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:00:52,207 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:52,207 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,207 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-04 00:00:52,207 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,207 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:00:52,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:52,207 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:52,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:52,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:00:52,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:52,207 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:00:52,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:00:52,208 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,208 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-04 00:00:52,209 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,209 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 00:00:52,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:52,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:00:52,209 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:00:52,210 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:52,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:00:52,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:00:52,210 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:00:52,210 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:00:52,210 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,210 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100450c5597ec4ff4302aeae24c4732e21ea, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310048cdc9c70ee8246748498f65b2384a9a6] mob files 2023-10-04 00:00:52,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100450c5597ec4ff4302aeae24c4732e21ea 2023-10-04 00:00:52,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310048cdc9c70ee8246748498f65b2384a9a6 2023-10-04 00:00:52,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-04 00:00:52,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-04 00:00:52,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,241 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696377652006Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696377652219 (+213 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696377652219Loading Region manifests for snaptb0-testExportFileSystemState at 1696377652219Writing data manifest for snaptb0-testExportFileSystemState at 1696377652222 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696377652232 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696377652241 (+9 ms) 2023-10-04 00:00:52,243 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 00:00:52,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 236 msec 2023-10-04 00:00:52,310 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:00:52,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 00:00:52,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:00:52,311 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377652311 2023-10-04 00:00:52,311 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43845, tgtDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377652311, rawTgtDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377652311, srcFsUri=hdfs://localhost:43845, srcDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:00:52,337 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:00:52,337 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-965954880_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377652311, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377652311/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,337 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d, snapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-04 00:00:52,353 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377652311/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 00:00:52,378 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:52,378 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:52,378 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:52,379 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:53,122 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-7930913947007993124.jar 2023-10-04 00:00:53,122 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:53,122 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:53,182 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-8799660204608613190.jar 2023-10-04 00:00:53,183 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:53,183 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:53,183 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:53,184 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:53,184 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:53,184 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 00:00:53,185 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 00:00:53,185 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 00:00:53,185 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 00:00:53,185 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 00:00:53,186 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 00:00:53,186 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 00:00:53,186 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 00:00:53,187 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 00:00:53,187 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 00:00:53,188 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 00:00:53,188 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:00:53,188 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:00:53,189 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:00:53,189 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:00:53,189 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:00:53,190 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:00:53,190 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:00:54,015 WARN [Listener at jenkins-hbase16.apache.org/38813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 00:00:54,018 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-04 00:00:54,020 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-04 00:00:54,355 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:00:54,355 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:00:54,362 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0001_000001 (auth:SIMPLE) 2023-10-04 00:00:54,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0002_000001 (auth:SIMPLE) 2023-10-04 00:00:55,978 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 00:00:58,000 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0002_000001 (auth:SIMPLE) 2023-10-04 00:01:00,205 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0002_000001 (auth:SIMPLE) 2023-10-04 00:01:05,217 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 00:01:05,218 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 00:01:05,226 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-04 00:01:05,226 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 00:01:05,226 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 00:01:05,226 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 00:01:05,227 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-04 00:01:05,227 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-04 00:01:05,227 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377652311/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377652311/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 00:01:05,228 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377652311/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-04 00:01:05,228 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377652311/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-04 00:01:05,236 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-04 00:01:05,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testExportFileSystemState 2023-10-04 00:01:05,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-04 00:01:05,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 00:01:05,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377665241"}]},"ts":"1696377665241"} 2023-10-04 00:01:05,242 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-04 00:01:05,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 00:01:05,367 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-04 00:01:05,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=429f9b6536781416a61c170270c51c12, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf4dee129a525ec9cd371eea26342d5a, UNASSIGN}] 2023-10-04 00:01:05,376 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf4dee129a525ec9cd371eea26342d5a, UNASSIGN 2023-10-04 00:01:05,376 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=429f9b6536781416a61c170270c51c12, UNASSIGN 2023-10-04 00:01:05,378 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cf4dee129a525ec9cd371eea26342d5a, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:05,379 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=429f9b6536781416a61c170270c51c12, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:05,379 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696377665378"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377665378"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377665378"}]},"ts":"1696377665378"} 2023-10-04 00:01:05,379 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696377665378"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377665378"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377665378"}]},"ts":"1696377665378"} 2023-10-04 00:01:05,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure cf4dee129a525ec9cd371eea26342d5a, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:01:05,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 429f9b6536781416a61c170270c51c12, server=jenkins-hbase16.apache.org,43449,1696377627431}] 2023-10-04 00:01:05,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 429f9b6536781416a61c170270c51c12 2023-10-04 00:01:05,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 429f9b6536781416a61c170270c51c12, disabling compactions & flushes 2023-10-04 00:01:05,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:01:05,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:01:05,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:01:05,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. after waiting 0 ms 2023-10-04 00:01:05,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:01:05,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing cf4dee129a525ec9cd371eea26342d5a, disabling compactions & flushes 2023-10-04 00:01:05,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:01:05,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:01:05,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. after waiting 0 ms 2023-10-04 00:01:05,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:01:05,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 00:01:05,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:01:05,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:01:05,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:01:05,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a. 2023-10-04 00:01:05,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:01:05,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for cf4dee129a525ec9cd371eea26342d5a: 2023-10-04 00:01:05,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12. 2023-10-04 00:01:05,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 429f9b6536781416a61c170270c51c12: 2023-10-04 00:01:05,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:01:05,560 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cf4dee129a525ec9cd371eea26342d5a, regionState=CLOSED 2023-10-04 00:01:05,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 429f9b6536781416a61c170270c51c12 2023-10-04 00:01:05,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696377665560"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377665560"}]},"ts":"1696377665560"} 2023-10-04 00:01:05,561 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=429f9b6536781416a61c170270c51c12, regionState=CLOSED 2023-10-04 00:01:05,561 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696377665561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377665561"}]},"ts":"1696377665561"} 2023-10-04 00:01:05,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-04 00:01:05,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure cf4dee129a525ec9cd371eea26342d5a, server=jenkins-hbase16.apache.org,44307,1696377627472 in 181 msec 2023-10-04 00:01:05,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-04 00:01:05,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 429f9b6536781416a61c170270c51c12, server=jenkins-hbase16.apache.org,43449,1696377627431 in 182 msec 2023-10-04 00:01:05,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cf4dee129a525ec9cd371eea26342d5a, UNASSIGN in 195 msec 2023-10-04 00:01:05,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-04 00:01:05,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=429f9b6536781416a61c170270c51c12, UNASSIGN in 196 msec 2023-10-04 00:01:05,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377665569"}]},"ts":"1696377665569"} 2023-10-04 00:01:05,570 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-04 00:01:05,575 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-04 00:01:05,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 340 msec 2023-10-04 00:01:05,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 00:01:05,855 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-04 00:01:05,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testExportFileSystemState 2023-10-04 00:01:05,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 00:01:05,864 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 00:01:05,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-04 00:01:05,865 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 00:01:05,867 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-04 00:01:05,871 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12 2023-10-04 00:01:05,871 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:01:05,873 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/recovered.edits] 2023-10-04 00:01:05,873 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/recovered.edits] 2023-10-04 00:01:05,878 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/cf/11c32b62537640d7bc0179c17316bbe1 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/cf/11c32b62537640d7bc0179c17316bbe1 2023-10-04 00:01:05,878 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/cf/d74c02da7ff048ba9980f2e1b508ca1d to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/cf/d74c02da7ff048ba9980f2e1b508ca1d 2023-10-04 00:01:05,881 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a/recovered.edits/9.seqid 2023-10-04 00:01:05,881 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12/recovered.edits/9.seqid 2023-10-04 00:01:05,882 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/cf4dee129a525ec9cd371eea26342d5a 2023-10-04 00:01:05,882 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemState/429f9b6536781416a61c170270c51c12 2023-10-04 00:01:05,882 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-04 00:01:05,882 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-04 00:01:05,883 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-04 00:01:05,888 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100450c5597ec4ff4302aeae24c4732e21ea to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100450c5597ec4ff4302aeae24c4732e21ea 2023-10-04 00:01:05,889 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310048cdc9c70ee8246748498f65b2384a9a6 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310048cdc9c70ee8246748498f65b2384a9a6 2023-10-04 00:01:05,890 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-04 00:01:05,893 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 00:01:05,896 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-04 00:01:05,898 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-04 00:01:05,900 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 00:01:05,900 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-04 00:01:05,900 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377665900"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:05,901 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377665900"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:05,905 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 00:01:05,905 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 429f9b6536781416a61c170270c51c12, NAME => 'testtb-testExportFileSystemState,,1696377650892.429f9b6536781416a61c170270c51c12.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cf4dee129a525ec9cd371eea26342d5a, NAME => 'testtb-testExportFileSystemState,1,1696377650892.cf4dee129a525ec9cd371eea26342d5a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 00:01:05,905 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-04 00:01:05,905 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696377665905"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:05,907 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-04 00:01:05,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 00:01:05,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 00:01:05,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 00:01:05,908 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 00:01:05,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 00:01:05,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 00:01:05,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 00:01:05,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 00:01:05,918 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 00:01:05,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 60 msec 2023-10-04 00:01:05,925 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 00:01:05,925 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 00:01:05,925 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 00:01:05,925 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:05,925 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 00:01:05,925 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:05,925 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:05,925 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:05,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-04 00:01:05,926 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-04 00:01:05,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-04 00:01:05,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-04 00:01:05,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testExportFileSystemState" 2023-10-04 00:01:05,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-04 00:01:05,964 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=769 (was 757) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_955129651_17 at /127.0.0.1:52042 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639775445_1 at /127.0.0.1:43568 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase16.apache.org/188.40.62.62:42453 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase16.apache.org/188.40.62.62:38477 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-639775445_1 at /127.0.0.1:50700 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929143297_17 at /127.0.0.1:43588 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_955129651_17 at /127.0.0.1:50726 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1959 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=938 (was 931) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=323 (was 290) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=4523 (was 4726) 2023-10-04 00:01:05,964 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-10-04 00:01:05,981 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=769, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=323, ProcessCount=172, AvailableMemoryMB=4522 2023-10-04 00:01:05,981 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-10-04 00:01:05,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 00:01:05,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-04 00:01:05,987 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 00:01:05,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-04 00:01:05,988 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 00:01:05,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 00:01:05,990 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:05,990 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:05,991 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48 empty. 2023-10-04 00:01:05,991 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9 empty. 2023-10-04 00:01:05,991 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:05,991 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:05,991 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-04 00:01:06,007 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-04 00:01:06,008 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => af8fcf9ece762dd3e80b2bf955ab2b48, NAME => 'testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:01:06,008 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 77177769d92d7a2b9457d1254dba7fd9, NAME => 'testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:01:06,036 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:06,036 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 77177769d92d7a2b9457d1254dba7fd9, disabling compactions & flushes 2023-10-04 00:01:06,036 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:06,036 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:06,036 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. after waiting 0 ms 2023-10-04 00:01:06,036 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:06,036 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:06,036 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 77177769d92d7a2b9457d1254dba7fd9: 2023-10-04 00:01:06,037 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:06,037 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing af8fcf9ece762dd3e80b2bf955ab2b48, disabling compactions & flushes 2023-10-04 00:01:06,037 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,037 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,037 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. after waiting 0 ms 2023-10-04 00:01:06,037 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,038 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,038 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for af8fcf9ece762dd3e80b2bf955ab2b48: 2023-10-04 00:01:06,040 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 00:01:06,041 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696377666041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377666041"}]},"ts":"1696377666041"} 2023-10-04 00:01:06,041 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696377666041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377666041"}]},"ts":"1696377666041"} 2023-10-04 00:01:06,043 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 00:01:06,044 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 00:01:06,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377666044"}]},"ts":"1696377666044"} 2023-10-04 00:01:06,046 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-04 00:01:06,067 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-10-04 00:01:06,068 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 00:01:06,068 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 00:01:06,068 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 00:01:06,068 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 00:01:06,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af8fcf9ece762dd3e80b2bf955ab2b48, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77177769d92d7a2b9457d1254dba7fd9, ASSIGN}] 2023-10-04 00:01:06,071 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77177769d92d7a2b9457d1254dba7fd9, ASSIGN 2023-10-04 00:01:06,071 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af8fcf9ece762dd3e80b2bf955ab2b48, ASSIGN 2023-10-04 00:01:06,072 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77177769d92d7a2b9457d1254dba7fd9, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,44307,1696377627472; forceNewPlan=false, retain=false 2023-10-04 00:01:06,072 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af8fcf9ece762dd3e80b2bf955ab2b48, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,41265,1696377627379; forceNewPlan=false, retain=false 2023-10-04 00:01:06,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 00:01:06,223 INFO [jenkins-hbase16:34927] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 00:01:06,226 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=af8fcf9ece762dd3e80b2bf955ab2b48, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,226 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=77177769d92d7a2b9457d1254dba7fd9, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,226 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696377666226"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377666226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377666226"}]},"ts":"1696377666226"} 2023-10-04 00:01:06,227 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696377666226"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377666226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377666226"}]},"ts":"1696377666226"} 2023-10-04 00:01:06,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure af8fcf9ece762dd3e80b2bf955ab2b48, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:01:06,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 77177769d92d7a2b9457d1254dba7fd9, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:01:06,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 00:01:06,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af8fcf9ece762dd3e80b2bf955ab2b48, NAME => 'testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 00:01:06,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:06,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 77177769d92d7a2b9457d1254dba7fd9, NAME => 'testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 00:01:06,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. service=AccessControlService 2023-10-04 00:01:06,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. service=AccessControlService 2023-10-04 00:01:06,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:01:06,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:01:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:06,396 INFO [StoreOpener-af8fcf9ece762dd3e80b2bf955ab2b48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:06,396 INFO [StoreOpener-77177769d92d7a2b9457d1254dba7fd9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:06,398 DEBUG [StoreOpener-af8fcf9ece762dd3e80b2bf955ab2b48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/cf 2023-10-04 00:01:06,398 DEBUG [StoreOpener-77177769d92d7a2b9457d1254dba7fd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/cf 2023-10-04 00:01:06,398 DEBUG [StoreOpener-af8fcf9ece762dd3e80b2bf955ab2b48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/cf 2023-10-04 00:01:06,398 DEBUG [StoreOpener-77177769d92d7a2b9457d1254dba7fd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/cf 2023-10-04 00:01:06,398 INFO [StoreOpener-af8fcf9ece762dd3e80b2bf955ab2b48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af8fcf9ece762dd3e80b2bf955ab2b48 columnFamilyName cf 2023-10-04 00:01:06,398 INFO [StoreOpener-77177769d92d7a2b9457d1254dba7fd9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77177769d92d7a2b9457d1254dba7fd9 columnFamilyName cf 2023-10-04 00:01:06,400 INFO [StoreOpener-af8fcf9ece762dd3e80b2bf955ab2b48-1] regionserver.HStore(310): Store=af8fcf9ece762dd3e80b2bf955ab2b48/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:01:06,400 INFO [StoreOpener-77177769d92d7a2b9457d1254dba7fd9-1] regionserver.HStore(310): Store=77177769d92d7a2b9457d1254dba7fd9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:01:06,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:06,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:06,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:06,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:06,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:06,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:06,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:01:06,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:01:06,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 77177769d92d7a2b9457d1254dba7fd9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74531706, jitterRate=0.11060896515846252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:01:06,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 77177769d92d7a2b9457d1254dba7fd9: 2023-10-04 00:01:06,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened af8fcf9ece762dd3e80b2bf955ab2b48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61799464, jitterRate=-0.07911622524261475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:01:06,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for af8fcf9ece762dd3e80b2bf955ab2b48: 2023-10-04 00:01:06,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9., pid=46, masterSystemTime=1696377666385 2023-10-04 00:01:06,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48., pid=45, masterSystemTime=1696377666383 2023-10-04 00:01:06,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:06,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:06,413 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=77177769d92d7a2b9457d1254dba7fd9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,413 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696377666413"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377666413"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377666413"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377666413"}]},"ts":"1696377666413"} 2023-10-04 00:01:06,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,414 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=af8fcf9ece762dd3e80b2bf955ab2b48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,414 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696377666414"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377666414"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377666414"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377666414"}]},"ts":"1696377666414"} 2023-10-04 00:01:06,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-04 00:01:06,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 77177769d92d7a2b9457d1254dba7fd9, server=jenkins-hbase16.apache.org,44307,1696377627472 in 183 msec 2023-10-04 00:01:06,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-04 00:01:06,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure af8fcf9ece762dd3e80b2bf955ab2b48, server=jenkins-hbase16.apache.org,41265,1696377627379 in 186 msec 2023-10-04 00:01:06,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77177769d92d7a2b9457d1254dba7fd9, ASSIGN in 348 msec 2023-10-04 00:01:06,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-04 00:01:06,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af8fcf9ece762dd3e80b2bf955ab2b48, ASSIGN in 349 msec 2023-10-04 00:01:06,419 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 00:01:06,420 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377666420"}]},"ts":"1696377666420"} 2023-10-04 00:01:06,421 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-04 00:01:06,432 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 00:01:06,433 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-04 00:01:06,434 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 00:01:06,442 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:06,442 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:06,442 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:06,442 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:06,450 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:06,450 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:06,451 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:06,451 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:06,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 467 msec 2023-10-04 00:01:06,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 00:01:06,594 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-04 00:01:06,601 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-04 00:01:06,602 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,604 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:01:06,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 00:01:06,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377666618 (current time:1696377666618). 2023-10-04 00:01:06,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:01:06,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x72e6a43a to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:06,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33019fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:06,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:06,640 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:53768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:06,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72e6a43a to 127.0.0.1:51489 2023-10-04 00:01:06,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:06,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x38052fea to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:06,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f858ba4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:06,661 DEBUG [hconnection-0x7cf9a267-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:06,664 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:53784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:06,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:06,670 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:34068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:06,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38052fea to 127.0.0.1:51489 2023-10-04 00:01:06,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:06,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 00:01:06,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:01:06,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 00:01:06,675 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:01:06,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 00:01:06,678 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 00:01:06,679 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696378266679 2023-10-04 00:01:06,679 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-04 00:01:06,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 00:01:06,680 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:01:06,680 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:01:06,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 00:01:06,683 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 00:01:06,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-10-04 00:01:06,686 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 00:01:06,686 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696378266686 2023-10-04 00:01:06,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,696 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-04 00:01:06,696 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:06,697 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-04 00:01:06,697 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-04 00:01:06,698 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,698 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,706 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:06,706 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:06,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:06,706 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,706 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:06,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:06,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:06,707 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,707 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,708 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,708 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:01:06,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 00:01:06,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 00:01:06,708 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 00:01:06,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 00:01:06,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 00:01:06,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 00:01:06,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,709 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 00:01:06,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,709 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 00:01:06,709 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 00:01:06,709 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:06,709 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:06,711 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 00:01:06,712 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 00:01:06,712 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 00:01:06,712 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 00:01:06,712 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 00:01:06,712 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 00:01:06,709 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:06,716 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 00:01:06,716 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 00:01:06,716 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 00:01:06,725 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,725 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,725 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:06,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:06,733 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,733 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:06,734 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:06,733 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,734 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:06,733 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:06,734 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,735 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:06,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:06,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-04 00:01:06,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c45e8b[Count = 1] remaining members to acquire global barrier 2023-10-04 00:01:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:06,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-04 00:01:06,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c45e8b[Count = 0] remaining members to acquire global barrier 2023-10-04 00:01:06,741 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-04 00:01:06,741 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,771 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,771 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,772 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 00:01:06,772 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 00:01:06,772 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:01:06,771 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,772 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,773 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 00:01:06,773 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 00:01:06,773 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,774 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:06,774 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,774 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:06,774 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:06,774 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:06,774 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:01:06,774 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. started... 2023-10-04 00:01:06,774 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:06,775 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. started... 2023-10-04 00:01:06,775 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af8fcf9ece762dd3e80b2bf955ab2b48: 2023-10-04 00:01:06,778 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 77177769d92d7a2b9457d1254dba7fd9: 2023-10-04 00:01:06,778 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,778 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,780 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:06,780 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:06,780 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:01:06,780 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:01:06,780 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:06,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 00:01:06,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:01:06,782 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:01:06,783 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 00:01:06,784 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:06,784 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 00:01:06,795 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. completed. 2023-10-04 00:01:06,795 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. completed. 2023-10-04 00:01:06,795 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,795 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:06,795 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:06,795 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:06,795 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:06,796 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:06,796 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,796 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,796 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 00:01:06,796 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 00:01:06,796 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:01:06,796 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:01:06,806 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,806 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 00:01:06,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:06,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:06,807 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:06,807 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 00:01:06,815 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,815 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 00:01:06,815 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:06,815 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 00:01:06,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:06,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:06,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase16.apache.org,44307,1696377627472': 2023-10-04 00:01:06,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-04 00:01:06,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:06,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:06,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:06,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:06,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase16.apache.org,41265,1696377627379': 2023-10-04 00:01:06,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-04 00:01:06,829 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-04 00:01:06,829 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:01:06,829 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:01:06,829 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,829 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:01:06,833 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,833 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:06,833 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,833 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:06,833 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,834 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:06,834 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,834 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:06,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:06,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:06,835 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,835 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:06,837 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,838 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,838 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,850 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,850 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:06,850 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,850 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:06,850 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,850 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:06,850 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:06,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:06,851 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:06,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:06,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:06,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,850 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:06,850 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:06,850 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:06,854 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,853 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-04 00:01:06,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:06,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:06,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:06,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,854 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:06,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:06,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:01:06,854 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:06,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:06,854 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:06,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:06,855 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:06,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:06,855 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,855 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 00:01:06,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,888 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-04 00:01:06,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,889 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:06,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696377666679Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696377666868 (+189 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696377666868Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696377666868Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696377666871 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696377666882 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696377666888 (+6 ms) 2023-10-04 00:01:06,891 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 00:01:06,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 211 msec 2023-10-04 00:01:06,983 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:06,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 00:01:06,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:01:06,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41265] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:01:06,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44307] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:01:06,998 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-04 00:01:06,998 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:06,999 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:01:07,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 00:01:07,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377667009 (current time:1696377667009). 2023-10-04 00:01:07,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:01:07,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x22360782 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:07,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13aa13f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:07,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:07,029 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:53786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:07,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22360782 to 127.0.0.1:51489 2023-10-04 00:01:07,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:07,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x55c9840b to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:07,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47d18327, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:07,051 DEBUG [hconnection-0x1336f1bb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:07,054 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:53800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:07,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:07,060 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:34084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:07,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55c9840b to 127.0.0.1:51489 2023-10-04 00:01:07,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:07,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 00:01:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:01:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 00:01:07,064 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:01:07,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 00:01:07,067 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 00:01:07,068 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696378267068 2023-10-04 00:01:07,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 00:01:07,068 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-04 00:01:07,070 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:01:07,070 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:01:07,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 00:01:07,072 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 00:01:07,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-10-04 00:01:07,074 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 00:01:07,075 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696378267075 2023-10-04 00:01:07,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-04 00:01:07,092 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-04 00:01:07,092 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:07,093 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-04 00:01:07,093 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-04 00:01:07,094 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,094 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,100 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,100 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:07,100 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:07,100 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:07,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:07,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:07,101 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,101 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,101 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,101 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:01:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 00:01:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 00:01:07,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 00:01:07,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 00:01:07,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 00:01:07,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 00:01:07,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 00:01:07,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 00:01:07,102 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 00:01:07,102 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 00:01:07,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 00:01:07,102 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:07,102 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:07,104 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 00:01:07,105 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 00:01:07,102 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 00:01:07,105 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:07,105 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 00:01:07,106 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 00:01:07,106 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 00:01:07,106 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 00:01:07,105 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 00:01:07,106 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 00:01:07,106 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 00:01:07,115 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,123 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,123 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,123 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:07,123 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:07,123 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,123 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:07,124 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,124 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:07,124 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,124 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 00:01:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:07,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-04 00:01:07,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53331aa0[Count = 1] remaining members to acquire global barrier 2023-10-04 00:01:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:07,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:07,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 00:01:07,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:07,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-04 00:01:07,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53331aa0[Count = 0] remaining members to acquire global barrier 2023-10-04 00:01:07,128 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-04 00:01:07,128 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,133 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,133 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,133 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,134 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,134 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 00:01:07,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,134 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 00:01:07,134 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:01:07,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,134 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,134 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:01:07,134 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 00:01:07,134 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 00:01:07,134 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:07,134 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:07,134 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:07,135 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. started... 2023-10-04 00:01:07,135 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:07,135 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:07,135 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:07,135 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 77177769d92d7a2b9457d1254dba7fd9 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-04 00:01:07,135 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. started... 2023-10-04 00:01:07,135 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2745): Flushing af8fcf9ece762dd3e80b2bf955ab2b48 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-04 00:01:07,142 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 00:01:07,142 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:07,142 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 00:01:07,164 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004ee9c0bb0b87d49419fc34f1a7e55a918 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004ee9c0bb0b87d49419fc34f1a7e55a918 2023-10-04 00:01:07,169 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231004f34c75731bfe4983af0a8a1aeb8bd1a9 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231004f34c75731bfe4983af0a8a1aeb8bd1a9 2023-10-04 00:01:07,170 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:07,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 00:01:07,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:01:07,171 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:01:07,185 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/.tmp/cf/df7102e437bb4e07b502c4862ddc1273 2023-10-04 00:01:07,191 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/.tmp/cf/df7102e437bb4e07b502c4862ddc1273 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/cf/df7102e437bb4e07b502c4862ddc1273 2023-10-04 00:01:07,196 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/cf/df7102e437bb4e07b502c4862ddc1273, entries=45, sequenceid=6, filesize=12.4 K 2023-10-04 00:01:07,197 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 77177769d92d7a2b9457d1254dba7fd9 in 62ms, sequenceid=6, compaction requested=false 2023-10-04 00:01:07,197 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-04 00:01:07,198 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 77177769d92d7a2b9457d1254dba7fd9: 2023-10-04 00:01:07,198 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 00:01:07,198 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:07,198 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/cf/df7102e437bb4e07b502c4862ddc1273] hfiles 2023-10-04 00:01:07,198 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/cf/df7102e437bb4e07b502c4862ddc1273 for snapshot=snaptb0-testConsecutiveExports 2023-10-04 00:01:07,205 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. completed. 2023-10-04 00:01:07,205 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:07,205 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:07,206 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:07,206 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,206 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 00:01:07,206 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:01:07,215 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 00:01:07,215 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,215 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,215 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 00:01:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 00:01:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 00:01:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase16.apache.org,44307,1696377627472': 2023-10-04 00:01:07,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-04 00:01:07,372 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:07,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 00:01:07,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:01:07,376 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-04 00:01:07,581 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/.tmp/cf/cf905f3268d44272b6443f613ef751ca 2023-10-04 00:01:07,595 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/.tmp/cf/cf905f3268d44272b6443f613ef751ca as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/cf/cf905f3268d44272b6443f613ef751ca 2023-10-04 00:01:07,603 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/cf/cf905f3268d44272b6443f613ef751ca, entries=5, sequenceid=6, filesize=5.7 K 2023-10-04 00:01:07,604 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for af8fcf9ece762dd3e80b2bf955ab2b48 in 469ms, sequenceid=6, compaction requested=false 2023-10-04 00:01:07,605 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af8fcf9ece762dd3e80b2bf955ab2b48: 2023-10-04 00:01:07,605 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 00:01:07,606 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:07,606 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/cf/cf905f3268d44272b6443f613ef751ca] hfiles 2023-10-04 00:01:07,606 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/cf/cf905f3268d44272b6443f613ef751ca for snapshot=snaptb0-testConsecutiveExports 2023-10-04 00:01:07,615 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. completed. 2023-10-04 00:01:07,616 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:07,616 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:07,616 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:07,616 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,616 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 00:01:07,616 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:01:07,625 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 00:01:07,625 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,625 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:07,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:07,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:07,625 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 00:01:07,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:07,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:07,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 00:01:07,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:07,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 00:01:07,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase16.apache.org,41265,1696377627379': 2023-10-04 00:01:07,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-04 00:01:07,635 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-04 00:01:07,635 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:01:07,635 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:01:07,635 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-04 00:01:07,635 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:01:07,642 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,642 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,642 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:07,642 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:07,642 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,642 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:07,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:07,643 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,643 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:07,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:07,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:07,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:07,644 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:07,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 00:01:07,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,645 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:07,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 00:01:07,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:07,648 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 00:01:07,649 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,649 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,676 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:07,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 00:01:07,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:01:07,678 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-04 00:01:07,694 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:07,694 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:07,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:07,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:07,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:07,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:07,695 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:07,694 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,694 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:07,697 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-04 00:01:07,695 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:07,695 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:07,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:07,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:07,697 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-04 00:01:07,697 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 00:01:07,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:07,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:07,697 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:07,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:01:07,698 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:07,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:07,699 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,699 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:07,699 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,699 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:07,699 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:07,699 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,699 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:07,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231004f34c75731bfe4983af0a8a1aeb8bd1a9, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004ee9c0bb0b87d49419fc34f1a7e55a918] mob files 2023-10-04 00:01:07,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231004f34c75731bfe4983af0a8a1aeb8bd1a9 2023-10-04 00:01:07,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004ee9c0bb0b87d49419fc34f1a7e55a918 2023-10-04 00:01:07,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-04 00:01:07,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-04 00:01:07,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,728 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 00:01:07,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696377667068Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696377667710 (+642 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696377667710Loading Region manifests for snaptb0-testConsecutiveExports at 1696377667710Writing data manifest for snaptb0-testConsecutiveExports at 1696377667713 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696377667720 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696377667727 (+7 ms) 2023-10-04 00:01:07,730 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 00:01:07,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 661 msec 2023-10-04 00:01:08,178 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:08,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 00:01:08,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:01:08,181 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181 2023-10-04 00:01:08,182 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181, srcFsUri=hdfs://localhost:43845, srcDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:01:08,204 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:01:08,204 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4ab14e9b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 00:01:08,204 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d, snapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-04 00:01:08,213 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 00:01:08,224 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,224 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,224 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,225 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,925 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-5160343305515832025.jar 2023-10-04 00:01:08,925 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,926 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,979 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-6743867469124678590.jar 2023-10-04 00:01:08,980 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,980 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,980 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,981 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,981 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,981 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:08,982 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 00:01:08,982 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 00:01:08,982 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 00:01:08,983 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 00:01:08,983 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 00:01:08,983 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 00:01:08,984 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 00:01:08,984 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 00:01:08,984 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 00:01:08,985 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 00:01:08,985 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:08,985 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:08,986 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:08,986 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:08,986 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:08,987 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:08,987 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:09,629 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0002_000001 (auth:SIMPLE) 2023-10-04 00:01:09,756 WARN [Listener at jenkins-hbase16.apache.org/38813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 00:01:09,758 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-04 00:01:09,760 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-04 00:01:09,821 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:01:09,821 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:01:10,001 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0003_000001 (auth:SIMPLE) 2023-10-04 00:01:11,142 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 00:01:13,713 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0003_000001 (auth:SIMPLE) 2023-10-04 00:01:15,915 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0003_000001 (auth:SIMPLE) 2023-10-04 00:01:17,837 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0003_000001 (auth:SIMPLE) 2023-10-04 00:01:17,847 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696377633735_0003_01_000002 is : 143 2023-10-04 00:01:18,940 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 00:01:18,940 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 00:01:18,943 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-04 00:01:18,943 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 00:01:18,944 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 00:01:18,944 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 00:01:18,945 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 00:01:18,945 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 00:01:18,945 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@23fb5fba in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 00:01:18,945 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 00:01:18,945 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 00:01:18,946 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181, srcFsUri=hdfs://localhost:43845, srcDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:01:18,964 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:01:18,964 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@753dab7d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 00:01:18,965 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d, snapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-04 00:01:18,974 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 00:01:18,985 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:18,985 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:18,986 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:18,986 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:19,683 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-7176060511853300932.jar 2023-10-04 00:01:19,683 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:19,684 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:19,736 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-6291036030502203173.jar 2023-10-04 00:01:19,736 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:19,737 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:19,737 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:19,737 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:19,738 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:19,738 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:19,738 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 00:01:19,739 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 00:01:19,739 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 00:01:19,739 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 00:01:19,739 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 00:01:19,740 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 00:01:19,740 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 00:01:19,740 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 00:01:19,741 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 00:01:19,741 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 00:01:19,741 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:19,742 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:19,742 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:19,742 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:19,743 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:19,743 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:19,743 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:20,095 WARN [Listener at jenkins-hbase16.apache.org/38813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 00:01:20,098 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-04 00:01:20,100 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-04 00:01:24,019 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:01:24,019 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:01:24,022 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0003_000001 (auth:SIMPLE) 2023-10-04 00:01:24,646 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0004_000001 (auth:SIMPLE) 2023-10-04 00:01:27,968 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0004_000001 (auth:SIMPLE) 2023-10-04 00:01:30,171 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0004_000001 (auth:SIMPLE) 2023-10-04 00:01:32,653 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0004_000001 (auth:SIMPLE) 2023-10-04 00:01:34,292 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 00:01:34,292 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 00:01:34,295 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-04 00:01:34,295 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 00:01:34,295 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 00:01:34,295 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 00:01:34,296 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 00:01:34,296 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 00:01:34,296 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@23fb5fba in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 00:01:34,296 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 00:01:34,296 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/local-export-1696377668181/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 00:01:34,307 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-04 00:01:34,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testConsecutiveExports 2023-10-04 00:01:34,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-04 00:01:34,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 00:01:34,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377694311"}]},"ts":"1696377694311"} 2023-10-04 00:01:34,312 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-04 00:01:34,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 00:01:34,523 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-04 00:01:34,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af8fcf9ece762dd3e80b2bf955ab2b48, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77177769d92d7a2b9457d1254dba7fd9, UNASSIGN}] 2023-10-04 00:01:34,532 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77177769d92d7a2b9457d1254dba7fd9, UNASSIGN 2023-10-04 00:01:34,532 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af8fcf9ece762dd3e80b2bf955ab2b48, UNASSIGN 2023-10-04 00:01:34,533 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=77177769d92d7a2b9457d1254dba7fd9, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:34,533 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=af8fcf9ece762dd3e80b2bf955ab2b48, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:34,533 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696377694533"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377694533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377694533"}]},"ts":"1696377694533"} 2023-10-04 00:01:34,533 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696377694533"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377694533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377694533"}]},"ts":"1696377694533"} 2023-10-04 00:01:34,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 77177769d92d7a2b9457d1254dba7fd9, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:01:34,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure af8fcf9ece762dd3e80b2bf955ab2b48, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:01:34,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 00:01:34,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:34,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:34,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 77177769d92d7a2b9457d1254dba7fd9, disabling compactions & flushes 2023-10-04 00:01:34,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:34,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:34,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. after waiting 0 ms 2023-10-04 00:01:34,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:34,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing af8fcf9ece762dd3e80b2bf955ab2b48, disabling compactions & flushes 2023-10-04 00:01:34,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:34,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:34,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. after waiting 0 ms 2023-10-04 00:01:34,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:34,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:01:34,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:01:34,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:01:34,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:01:34,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48. 2023-10-04 00:01:34,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for af8fcf9ece762dd3e80b2bf955ab2b48: 2023-10-04 00:01:34,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9. 2023-10-04 00:01:34,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 77177769d92d7a2b9457d1254dba7fd9: 2023-10-04 00:01:34,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:34,711 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=77177769d92d7a2b9457d1254dba7fd9, regionState=CLOSED 2023-10-04 00:01:34,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:34,711 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696377694711"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377694711"}]},"ts":"1696377694711"} 2023-10-04 00:01:34,711 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=af8fcf9ece762dd3e80b2bf955ab2b48, regionState=CLOSED 2023-10-04 00:01:34,712 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696377694711"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377694711"}]},"ts":"1696377694711"} 2023-10-04 00:01:34,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-10-04 00:01:34,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 77177769d92d7a2b9457d1254dba7fd9, server=jenkins-hbase16.apache.org,44307,1696377627472 in 178 msec 2023-10-04 00:01:34,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-10-04 00:01:34,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure af8fcf9ece762dd3e80b2bf955ab2b48, server=jenkins-hbase16.apache.org,41265,1696377627379 in 178 msec 2023-10-04 00:01:34,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77177769d92d7a2b9457d1254dba7fd9, UNASSIGN in 188 msec 2023-10-04 00:01:34,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-04 00:01:34,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af8fcf9ece762dd3e80b2bf955ab2b48, UNASSIGN in 189 msec 2023-10-04 00:01:34,717 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377694717"}]},"ts":"1696377694717"} 2023-10-04 00:01:34,719 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-04 00:01:34,730 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-04 00:01:34,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 423 msec 2023-10-04 00:01:34,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 00:01:34,918 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-04 00:01:34,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testConsecutiveExports 2023-10-04 00:01:34,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 00:01:34,925 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 00:01:34,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-04 00:01:34,927 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 00:01:34,933 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-04 00:01:34,937 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:34,937 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:34,939 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/recovered.edits] 2023-10-04 00:01:34,939 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/recovered.edits] 2023-10-04 00:01:34,944 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/cf/cf905f3268d44272b6443f613ef751ca to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/cf/cf905f3268d44272b6443f613ef751ca 2023-10-04 00:01:34,944 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/cf/df7102e437bb4e07b502c4862ddc1273 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/cf/df7102e437bb4e07b502c4862ddc1273 2023-10-04 00:01:34,947 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48/recovered.edits/9.seqid 2023-10-04 00:01:34,947 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9/recovered.edits/9.seqid 2023-10-04 00:01:34,949 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/af8fcf9ece762dd3e80b2bf955ab2b48 2023-10-04 00:01:34,949 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 00:01:34,949 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 00:01:34,949 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testConsecutiveExports/77177769d92d7a2b9457d1254dba7fd9 2023-10-04 00:01:34,949 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 00:01:34,949 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 00:01:34,949 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-04 00:01:34,949 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 00:01:34,949 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 00:01:34,949 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 00:01:34,950 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 00:01:34,950 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-04 00:01:34,950 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-04 00:01:34,954 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231004f34c75731bfe4983af0a8a1aeb8bd1a9 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231004f34c75731bfe4983af0a8a1aeb8bd1a9 2023-10-04 00:01:34,955 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004ee9c0bb0b87d49419fc34f1a7e55a918 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231004ee9c0bb0b87d49419fc34f1a7e55a918 2023-10-04 00:01:34,956 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-04 00:01:34,957 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 00:01:34,957 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 00:01:34,957 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 00:01:34,957 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 00:01:34,957 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:34,957 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:34,957 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:34,957 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:34,958 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 00:01:34,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-04 00:01:34,960 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-04 00:01:34,962 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-04 00:01:34,963 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 00:01:34,963 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-04 00:01:34,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377694964"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:34,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377694964"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:34,966 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 00:01:34,966 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => af8fcf9ece762dd3e80b2bf955ab2b48, NAME => 'testtb-testConsecutiveExports,,1696377665983.af8fcf9ece762dd3e80b2bf955ab2b48.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 77177769d92d7a2b9457d1254dba7fd9, NAME => 'testtb-testConsecutiveExports,1,1696377665983.77177769d92d7a2b9457d1254dba7fd9.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 00:01:34,966 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-04 00:01:34,966 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696377694966"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:34,968 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-04 00:01:34,975 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 00:01:34,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 55 msec 2023-10-04 00:01:35,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-04 00:01:35,060 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-04 00:01:35,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-04 00:01:35,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-04 00:01:35,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testConsecutiveExports" 2023-10-04 00:01:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-04 00:01:35,096 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=759 (was 769), OpenFileDescriptor=922 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=267 (was 323), ProcessCount=171 (was 172), AvailableMemoryMB=4382 (was 4522) 2023-10-04 00:01:35,096 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-10-04 00:01:35,112 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=171, AvailableMemoryMB=4382 2023-10-04 00:01:35,112 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-10-04 00:01:35,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 00:01:35,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,117 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 00:01:35,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-04 00:01:35,117 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 00:01:35,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 00:01:35,120 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:35,120 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416 2023-10-04 00:01:35,120 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416 empty. 2023-10-04 00:01:35,120 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8 empty. 2023-10-04 00:01:35,121 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416 2023-10-04 00:01:35,121 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:35,121 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-04 00:01:35,131 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-04 00:01:35,132 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 31dd95ac9f7e45ff17c0b15b6fa513e8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:01:35,133 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => e827086b0687356c74e4e2731943d416, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing e827086b0687356c74e4e2731943d416, disabling compactions & flushes 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 31dd95ac9f7e45ff17c0b15b6fa513e8, disabling compactions & flushes 2023-10-04 00:01:35,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:35,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. after waiting 0 ms 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. after waiting 0 ms 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:35,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:35,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for e827086b0687356c74e4e2731943d416: 2023-10-04 00:01:35,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 31dd95ac9f7e45ff17c0b15b6fa513e8: 2023-10-04 00:01:35,149 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 00:01:35,149 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696377695149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377695149"}]},"ts":"1696377695149"} 2023-10-04 00:01:35,149 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696377695149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377695149"}]},"ts":"1696377695149"} 2023-10-04 00:01:35,155 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 00:01:35,156 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 00:01:35,157 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377695156"}]},"ts":"1696377695156"} 2023-10-04 00:01:35,158 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-04 00:01:35,174 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-10-04 00:01:35,175 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 00:01:35,175 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 00:01:35,175 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 00:01:35,175 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 00:01:35,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31dd95ac9f7e45ff17c0b15b6fa513e8, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e827086b0687356c74e4e2731943d416, ASSIGN}] 2023-10-04 00:01:35,177 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e827086b0687356c74e4e2731943d416, ASSIGN 2023-10-04 00:01:35,178 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31dd95ac9f7e45ff17c0b15b6fa513e8, ASSIGN 2023-10-04 00:01:35,178 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e827086b0687356c74e4e2731943d416, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,44307,1696377627472; forceNewPlan=false, retain=false 2023-10-04 00:01:35,178 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31dd95ac9f7e45ff17c0b15b6fa513e8, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,41265,1696377627379; forceNewPlan=false, retain=false 2023-10-04 00:01:35,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 00:01:35,329 INFO [jenkins-hbase16:34927] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 00:01:35,334 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=31dd95ac9f7e45ff17c0b15b6fa513e8, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=e827086b0687356c74e4e2731943d416, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,334 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696377695334"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377695334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377695334"}]},"ts":"1696377695334"} 2023-10-04 00:01:35,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696377695334"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377695334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377695334"}]},"ts":"1696377695334"} 2023-10-04 00:01:35,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 31dd95ac9f7e45ff17c0b15b6fa513e8, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:01:35,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure e827086b0687356c74e4e2731943d416, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:01:35,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 00:01:35,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:35,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 31dd95ac9f7e45ff17c0b15b6fa513e8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 00:01:35,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:35,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. service=AccessControlService 2023-10-04 00:01:35,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e827086b0687356c74e4e2731943d416, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 00:01:35,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:01:35,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:35,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. service=AccessControlService 2023-10-04 00:01:35,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:35,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:35,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:01:35,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:35,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e827086b0687356c74e4e2731943d416 2023-10-04 00:01:35,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:35,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for e827086b0687356c74e4e2731943d416 2023-10-04 00:01:35,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for e827086b0687356c74e4e2731943d416 2023-10-04 00:01:35,510 INFO [StoreOpener-e827086b0687356c74e4e2731943d416-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e827086b0687356c74e4e2731943d416 2023-10-04 00:01:35,510 INFO [StoreOpener-31dd95ac9f7e45ff17c0b15b6fa513e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:35,512 DEBUG [StoreOpener-e827086b0687356c74e4e2731943d416-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/cf 2023-10-04 00:01:35,512 DEBUG [StoreOpener-31dd95ac9f7e45ff17c0b15b6fa513e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/cf 2023-10-04 00:01:35,512 DEBUG [StoreOpener-31dd95ac9f7e45ff17c0b15b6fa513e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/cf 2023-10-04 00:01:35,512 DEBUG [StoreOpener-e827086b0687356c74e4e2731943d416-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/cf 2023-10-04 00:01:35,513 INFO [StoreOpener-31dd95ac9f7e45ff17c0b15b6fa513e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31dd95ac9f7e45ff17c0b15b6fa513e8 columnFamilyName cf 2023-10-04 00:01:35,513 INFO [StoreOpener-e827086b0687356c74e4e2731943d416-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e827086b0687356c74e4e2731943d416 columnFamilyName cf 2023-10-04 00:01:35,514 INFO [StoreOpener-31dd95ac9f7e45ff17c0b15b6fa513e8-1] regionserver.HStore(310): Store=31dd95ac9f7e45ff17c0b15b6fa513e8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:01:35,514 INFO [StoreOpener-e827086b0687356c74e4e2731943d416-1] regionserver.HStore(310): Store=e827086b0687356c74e4e2731943d416/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:01:35,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416 2023-10-04 00:01:35,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:35,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416 2023-10-04 00:01:35,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:35,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for e827086b0687356c74e4e2731943d416 2023-10-04 00:01:35,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:35,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:01:35,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:01:35,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 31dd95ac9f7e45ff17c0b15b6fa513e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73356472, jitterRate=0.09309661388397217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:01:35,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 31dd95ac9f7e45ff17c0b15b6fa513e8: 2023-10-04 00:01:35,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened e827086b0687356c74e4e2731943d416; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69803095, jitterRate=0.040147170424461365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:01:35,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for e827086b0687356c74e4e2731943d416: 2023-10-04 00:01:35,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416., pid=61, masterSystemTime=1696377695497 2023-10-04 00:01:35,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8., pid=60, masterSystemTime=1696377695491 2023-10-04 00:01:35,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:35,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:35,525 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=e827086b0687356c74e4e2731943d416, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,525 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696377695525"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377695525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377695525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377695525"}]},"ts":"1696377695525"} 2023-10-04 00:01:35,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:35,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:35,526 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=31dd95ac9f7e45ff17c0b15b6fa513e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,526 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696377695526"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377695526"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377695526"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377695526"}]},"ts":"1696377695526"} 2023-10-04 00:01:35,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-04 00:01:35,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure e827086b0687356c74e4e2731943d416, server=jenkins-hbase16.apache.org,44307,1696377627472 in 187 msec 2023-10-04 00:01:35,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-04 00:01:35,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 31dd95ac9f7e45ff17c0b15b6fa513e8, server=jenkins-hbase16.apache.org,41265,1696377627379 in 190 msec 2023-10-04 00:01:35,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e827086b0687356c74e4e2731943d416, ASSIGN in 354 msec 2023-10-04 00:01:35,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-10-04 00:01:35,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31dd95ac9f7e45ff17c0b15b6fa513e8, ASSIGN in 355 msec 2023-10-04 00:01:35,532 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 00:01:35,532 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377695532"}]},"ts":"1696377695532"} 2023-10-04 00:01:35,534 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-04 00:01:35,567 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 00:01:35,567 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-04 00:01:35,569 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 00:01:35,574 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:35,574 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:35,574 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:35,574 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:35,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:35,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:35,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:35,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:35,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 468 msec 2023-10-04 00:01:35,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 00:01:35,723 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-04 00:01:35,727 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,727 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:35,730 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:01:35,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 00:01:35,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377695746 (current time:1696377695746). 2023-10-04 00:01:35,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:01:35,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x6b93c91b to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:35,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c9afa05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:35,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:35,762 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:35,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b93c91b to 127.0.0.1:51489 2023-10-04 00:01:35,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:35,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x48e2b4fe to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:35,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d4c67e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:35,786 DEBUG [hconnection-0x162de896-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:35,787 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:35,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:35,797 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:35,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48e2b4fe to 127.0.0.1:51489 2023-10-04 00:01:35,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:35,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 00:01:35,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:01:35,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 00:01:35,804 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:01:35,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 00:01:35,806 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 00:01:35,807 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696378295807 2023-10-04 00:01:35,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 00:01:35,809 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:01:35,809 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:01:35,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 00:01:35,810 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 00:01:35,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-10-04 00:01:35,813 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 00:01:35,813 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696378295813 2023-10-04 00:01:35,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,826 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-04 00:01:35,826 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:35,827 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-04 00:01:35,827 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-04 00:01:35,827 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,828 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,832 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:35,832 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,832 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:35,832 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:35,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:35,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:35,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:35,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:35,833 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,833 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,833 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,833 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:01:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 00:01:35,834 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 00:01:35,834 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,834 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 00:01:35,835 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:35,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,835 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 00:01:35,836 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 00:01:35,836 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:35,836 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 00:01:35,837 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 00:01:35,837 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 00:01:35,837 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 00:01:35,837 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 00:01:35,836 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 00:01:35,837 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 00:01:35,837 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 00:01:35,847 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,847 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,847 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:35,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:35,855 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,855 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:35,855 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,856 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:35,855 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,856 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:35,856 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:35,856 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:35,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 00:01:35,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e2c5c03[Count = 1] remaining members to acquire global barrier 2023-10-04 00:01:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:35,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:35,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:35,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:35,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 00:01:35,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e2c5c03[Count = 0] remaining members to acquire global barrier 2023-10-04 00:01:35,863 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-04 00:01:35,863 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,874 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,874 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,874 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,878 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 00:01:35,878 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,878 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 00:01:35,878 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:35,878 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:35,878 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 00:01:35,879 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:35,879 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,879 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. started... 2023-10-04 00:01:35,879 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 00:01:35,879 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:01:35,879 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 31dd95ac9f7e45ff17c0b15b6fa513e8: 2023-10-04 00:01:35,878 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:35,880 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:35,880 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,880 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:35,878 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:35,880 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:01:35,879 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:01:35,879 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. started... 2023-10-04 00:01:35,883 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e827086b0687356c74e4e2731943d416: 2023-10-04 00:01:35,883 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,883 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:35,883 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:01:35,892 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. completed. 2023-10-04 00:01:35,893 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. completed. 2023-10-04 00:01:35,893 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:35,893 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:35,893 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:35,893 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:35,893 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:35,893 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:35,893 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,893 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,893 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 00:01:35,893 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 00:01:35,893 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:01:35,893 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:01:35,909 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:35,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 00:01:35,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:01:35,911 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:01:35,914 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 00:01:35,914 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:35,914 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 00:01:35,931 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 00:01:35,931 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,931 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:35,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:35,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:35,931 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 00:01:35,941 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:35,941 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 00:01:35,941 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:35,941 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 00:01:35,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:35,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase16.apache.org,44307,1696377627472': 2023-10-04 00:01:35,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-04 00:01:35,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:35,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:35,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase16.apache.org,41265,1696377627379': 2023-10-04 00:01:35,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-04 00:01:35,957 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-04 00:01:35,957 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:01:35,958 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:01:35,958 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,958 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:01:35,965 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,965 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:35,965 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,965 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,966 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:35,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,965 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,966 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:35,966 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:35,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:35,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:35,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:35,967 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,967 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:35,968 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,969 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,969 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,974 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,974 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:35,974 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:35,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:35,974 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:35,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:35,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:35,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:35,974 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:35,974 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:35,974 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:35,974 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,974 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:35,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:35,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:35,974 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:35,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:01:35,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:35,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:35,976 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,977 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:35,977 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,977 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:35,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:35,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:35,977 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,977 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:35,977 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:35,977 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,977 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 00:01:35,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:35,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,004 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-04 00:01:36,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,005 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696377695807Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696377695984 (+177 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696377695984Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696377695984Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696377695987 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696377695999 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696377696004 (+5 ms) 2023-10-04 00:01:36,006 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 00:01:36,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 198 msec 2023-10-04 00:01:36,111 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:36,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 00:01:36,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:01:36,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41265] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:01:36,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44307] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:01:36,126 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,127 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:36,127 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:01:36,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 00:01:36,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377696136 (current time:1696377696136). 2023-10-04 00:01:36,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:01:36,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x3f580b3e to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:36,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@241b940e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:36,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:36,153 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:36,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f580b3e to 127.0.0.1:51489 2023-10-04 00:01:36,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:36,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x5b4489e2 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:36,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24ba684f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:36,174 DEBUG [hconnection-0x5cf93332-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:36,177 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:36,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:36,184 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:36,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b4489e2 to 127.0.0.1:51489 2023-10-04 00:01:36,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:36,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 00:01:36,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:01:36,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 00:01:36,189 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:01:36,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 00:01:36,192 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 00:01:36,193 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696378296193 2023-10-04 00:01:36,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 00:01:36,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,194 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:01:36,195 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:01:36,196 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 00:01:36,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 00:01:36,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-10-04 00:01:36,198 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 00:01:36,199 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696378296199 2023-10-04 00:01:36,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,206 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-04 00:01:36,206 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:36,207 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-04 00:01:36,207 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-04 00:01:36,208 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,208 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,216 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,216 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:36,216 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:36,216 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:36,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:36,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:36,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:36,216 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,216 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,217 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,217 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,217 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 00:01:36,217 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 00:01:36,218 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:36,217 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 00:01:36,219 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 00:01:36,219 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 00:01:36,219 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 00:01:36,218 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:36,219 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:36,220 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 00:01:36,221 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 00:01:36,221 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 00:01:36,221 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 00:01:36,221 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 00:01:36,221 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 00:01:36,230 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,230 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:36,239 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:36,239 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,239 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:36,239 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,239 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:36,239 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,239 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:36,239 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,239 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:36,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 00:01:36,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ef38c44[Count = 1] remaining members to acquire global barrier 2023-10-04 00:01:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:36,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 00:01:36,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ef38c44[Count = 0] remaining members to acquire global barrier 2023-10-04 00:01:36,242 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-04 00:01:36,242 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,249 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,249 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,249 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,249 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 00:01:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,249 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,249 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 00:01:36,249 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 00:01:36,249 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:01:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,249 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 00:01:36,249 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:36,250 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:36,250 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:36,250 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:36,250 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,250 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:01:36,250 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. started... 2023-10-04 00:01:36,250 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. started... 2023-10-04 00:01:36,250 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:36,250 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:36,250 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 31dd95ac9f7e45ff17c0b15b6fa513e8 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-04 00:01:36,250 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e827086b0687356c74e4e2731943d416 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-04 00:01:36,257 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 00:01:36,257 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:36,257 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 00:01:36,272 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100462cd63c0304145808a504635baecbd48 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023100462cd63c0304145808a504635baecbd48 2023-10-04 00:01:36,274 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100414e725af18804b209552d38fbb5ab1e0 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100414e725af18804b209552d38fbb5ab1e0 2023-10-04 00:01:36,281 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/.tmp/cf/915253aacdec43e4ab39f54da022a169 2023-10-04 00:01:36,281 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/.tmp/cf/c29d2d2120a84f2eb68c9b4587f83609 2023-10-04 00:01:36,286 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/.tmp/cf/915253aacdec43e4ab39f54da022a169 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/cf/915253aacdec43e4ab39f54da022a169 2023-10-04 00:01:36,286 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/.tmp/cf/c29d2d2120a84f2eb68c9b4587f83609 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/cf/c29d2d2120a84f2eb68c9b4587f83609 2023-10-04 00:01:36,290 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/cf/915253aacdec43e4ab39f54da022a169, entries=46, sequenceid=6, filesize=13.3 K 2023-10-04 00:01:36,290 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/cf/c29d2d2120a84f2eb68c9b4587f83609, entries=4, sequenceid=6, filesize=5.6 K 2023-10-04 00:01:36,291 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for e827086b0687356c74e4e2731943d416 in 41ms, sequenceid=6, compaction requested=false 2023-10-04 00:01:36,291 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-04 00:01:36,291 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e827086b0687356c74e4e2731943d416: 2023-10-04 00:01:36,291 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 31dd95ac9f7e45ff17c0b15b6fa513e8 in 41ms, sequenceid=6, compaction requested=false 2023-10-04 00:01:36,291 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,293 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 31dd95ac9f7e45ff17c0b15b6fa513e8: 2023-10-04 00:01:36,293 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:36,293 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/cf/915253aacdec43e4ab39f54da022a169] hfiles 2023-10-04 00:01:36,293 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,293 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/cf/915253aacdec43e4ab39f54da022a169 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,293 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:36,293 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/cf/c29d2d2120a84f2eb68c9b4587f83609] hfiles 2023-10-04 00:01:36,293 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/cf/c29d2d2120a84f2eb68c9b4587f83609 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,296 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:36,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 00:01:36,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:01:36,297 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:01:36,300 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. completed. 2023-10-04 00:01:36,300 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:36,300 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:36,300 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:36,300 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,300 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. completed. 2023-10-04 00:01:36,300 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 00:01:36,300 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:36,300 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:01:36,300 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:36,300 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:36,300 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,300 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 00:01:36,300 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:01:36,307 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,307 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 00:01:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,307 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:36,307 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 00:01:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:36,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:36,332 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:36,332 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 00:01:36,332 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:36,332 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 00:01:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase16.apache.org,41265,1696377627379': 2023-10-04 00:01:36,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-04 00:01:36,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:36,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:36,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:36,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase16.apache.org,44307,1696377627472': 2023-10-04 00:01:36,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-04 00:01:36,339 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-04 00:01:36,339 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:01:36,339 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:01:36,339 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,339 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:01:36,349 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,349 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,349 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:36,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:36,349 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,349 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:36,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,349 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:36,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,349 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:36,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:36,350 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:36,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:36,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:36,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:36,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:36,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:36,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:36,350 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,351 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:36,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,352 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,352 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,352 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,357 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:36,357 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:36,357 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,357 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:36,357 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:36,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:36,357 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:36,357 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:36,357 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:36,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:36,359 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,357 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:36,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,357 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:36,359 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:36,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:01:36,359 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:36,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:36,359 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:36,359 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,360 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,360 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,360 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,360 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:36,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100414e725af18804b209552d38fbb5ab1e0, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023100462cd63c0304145808a504635baecbd48] mob files 2023-10-04 00:01:36,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100414e725af18804b209552d38fbb5ab1e0 2023-10-04 00:01:36,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023100462cd63c0304145808a504635baecbd48 2023-10-04 00:01:36,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-04 00:01:36,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,384 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:36,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696377696193Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696377696367 (+174 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696377696367Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696377696367Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696377696370 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696377696376 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696377696384 (+8 ms) 2023-10-04 00:01:36,386 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 00:01:36,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 192 msec 2023-10-04 00:01:36,498 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:36,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 00:01:36,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:01:36,533 DEBUG [Listener at jenkins-hbase16.apache.org/38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 00:01:36,536 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 00:01:36,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41265] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 00:01:36,538 DEBUG [Listener at jenkins-hbase16.apache.org/38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 00:01:36,540 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 00:01:36,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43449] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 00:01:36,541 DEBUG [Listener at jenkins-hbase16.apache.org/38813] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 00:01:36,545 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:39892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 00:01:36,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44307] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 00:01:36,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-04 00:01:36,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:36,551 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 00:01:36,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-04 00:01:36,552 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 00:01:36,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 00:01:36,554 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b 2023-10-04 00:01:36,554 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:36,555 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b empty. 2023-10-04 00:01:36,555 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5 empty. 2023-10-04 00:01:36,555 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b 2023-10-04 00:01:36,555 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:36,555 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-04 00:01:36,563 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-04 00:01:36,564 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8711e917be437d73700501af5126a69b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:01:36,564 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 57f9574b5a22a1cc2210ff96e09515b5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 57f9574b5a22a1cc2210ff96e09515b5, disabling compactions & flushes 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 8711e917be437d73700501af5126a69b, disabling compactions & flushes 2023-10-04 00:01:36,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:36,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. after waiting 0 ms 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. after waiting 0 ms 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:36,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:36,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 57f9574b5a22a1cc2210ff96e09515b5: 2023-10-04 00:01:36,574 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 8711e917be437d73700501af5126a69b: 2023-10-04 00:01:36,576 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 00:01:36,577 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696377696577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377696577"}]},"ts":"1696377696577"} 2023-10-04 00:01:36,577 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696377696577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377696577"}]},"ts":"1696377696577"} 2023-10-04 00:01:36,579 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 00:01:36,580 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 00:01:36,580 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377696580"}]},"ts":"1696377696580"} 2023-10-04 00:01:36,581 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-04 00:01:36,599 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-10-04 00:01:36,601 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 00:01:36,601 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 00:01:36,601 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 00:01:36,601 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 00:01:36,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8711e917be437d73700501af5126a69b, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57f9574b5a22a1cc2210ff96e09515b5, ASSIGN}] 2023-10-04 00:01:36,605 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57f9574b5a22a1cc2210ff96e09515b5, ASSIGN 2023-10-04 00:01:36,605 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8711e917be437d73700501af5126a69b, ASSIGN 2023-10-04 00:01:36,606 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57f9574b5a22a1cc2210ff96e09515b5, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,43449,1696377627431; forceNewPlan=false, retain=false 2023-10-04 00:01:36,607 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8711e917be437d73700501af5126a69b, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,44307,1696377627472; forceNewPlan=false, retain=false 2023-10-04 00:01:36,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 00:01:36,756 INFO [jenkins-hbase16:34927] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 00:01:36,762 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8711e917be437d73700501af5126a69b, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,762 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=57f9574b5a22a1cc2210ff96e09515b5, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,763 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696377696762"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377696762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377696762"}]},"ts":"1696377696762"} 2023-10-04 00:01:36,763 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696377696762"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377696762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377696762"}]},"ts":"1696377696762"} 2023-10-04 00:01:36,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 8711e917be437d73700501af5126a69b, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:01:36,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 57f9574b5a22a1cc2210ff96e09515b5, server=jenkins-hbase16.apache.org,43449,1696377627431}] 2023-10-04 00:01:36,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 00:01:36,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:36,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:36,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 57f9574b5a22a1cc2210ff96e09515b5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5.', STARTKEY => '2', ENDKEY => ''} 2023-10-04 00:01:36,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8711e917be437d73700501af5126a69b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b.', STARTKEY => '', ENDKEY => '2'} 2023-10-04 00:01:36,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. service=AccessControlService 2023-10-04 00:01:36,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. service=AccessControlService 2023-10-04 00:01:36,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:01:36,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:01:36,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:36,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8711e917be437d73700501af5126a69b 2023-10-04 00:01:36,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:36,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:36,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:36,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 8711e917be437d73700501af5126a69b 2023-10-04 00:01:36,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 8711e917be437d73700501af5126a69b 2023-10-04 00:01:36,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:36,934 INFO [StoreOpener-8711e917be437d73700501af5126a69b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8711e917be437d73700501af5126a69b 2023-10-04 00:01:36,934 INFO [StoreOpener-57f9574b5a22a1cc2210ff96e09515b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:36,935 DEBUG [StoreOpener-8711e917be437d73700501af5126a69b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/cf 2023-10-04 00:01:36,935 DEBUG [StoreOpener-8711e917be437d73700501af5126a69b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/cf 2023-10-04 00:01:36,935 DEBUG [StoreOpener-57f9574b5a22a1cc2210ff96e09515b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/cf 2023-10-04 00:01:36,935 DEBUG [StoreOpener-57f9574b5a22a1cc2210ff96e09515b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/cf 2023-10-04 00:01:36,936 INFO [StoreOpener-8711e917be437d73700501af5126a69b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8711e917be437d73700501af5126a69b columnFamilyName cf 2023-10-04 00:01:36,936 INFO [StoreOpener-57f9574b5a22a1cc2210ff96e09515b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57f9574b5a22a1cc2210ff96e09515b5 columnFamilyName cf 2023-10-04 00:01:36,936 INFO [StoreOpener-8711e917be437d73700501af5126a69b-1] regionserver.HStore(310): Store=8711e917be437d73700501af5126a69b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:01:36,936 INFO [StoreOpener-57f9574b5a22a1cc2210ff96e09515b5-1] regionserver.HStore(310): Store=57f9574b5a22a1cc2210ff96e09515b5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:01:36,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b 2023-10-04 00:01:36,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:36,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b 2023-10-04 00:01:36,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:36,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 8711e917be437d73700501af5126a69b 2023-10-04 00:01:36,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:36,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:01:36,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:01:36,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 8711e917be437d73700501af5126a69b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60577313, jitterRate=-0.09732769429683685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:01:36,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 8711e917be437d73700501af5126a69b: 2023-10-04 00:01:36,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 57f9574b5a22a1cc2210ff96e09515b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61512934, jitterRate=-0.08338585495948792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:01:36,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 57f9574b5a22a1cc2210ff96e09515b5: 2023-10-04 00:01:36,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b., pid=69, masterSystemTime=1696377696920 2023-10-04 00:01:36,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5., pid=70, masterSystemTime=1696377696920 2023-10-04 00:01:36,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:36,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:36,946 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8711e917be437d73700501af5126a69b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:36,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:36,946 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696377696946"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377696946"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377696946"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377696946"}]},"ts":"1696377696946"} 2023-10-04 00:01:36,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:36,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=57f9574b5a22a1cc2210ff96e09515b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:36,947 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696377696947"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377696947"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377696947"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377696947"}]},"ts":"1696377696947"} 2023-10-04 00:01:36,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-04 00:01:36,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 8711e917be437d73700501af5126a69b, server=jenkins-hbase16.apache.org,44307,1696377627472 in 181 msec 2023-10-04 00:01:36,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-10-04 00:01:36,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 57f9574b5a22a1cc2210ff96e09515b5, server=jenkins-hbase16.apache.org,43449,1696377627431 in 180 msec 2023-10-04 00:01:36,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8711e917be437d73700501af5126a69b, ASSIGN in 349 msec 2023-10-04 00:01:36,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-10-04 00:01:36,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57f9574b5a22a1cc2210ff96e09515b5, ASSIGN in 349 msec 2023-10-04 00:01:36,952 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 00:01:36,952 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377696952"}]},"ts":"1696377696952"} 2023-10-04 00:01:36,954 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-04 00:01:36,983 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 00:01:36,984 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-04 00:01:36,986 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-04 00:01:36,991 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:36,991 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:36,991 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:36,991 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:37,000 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:37,000 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:37,000 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:37,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:37,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:37,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:37,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:37,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:37,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 451 msec 2023-10-04 00:01:37,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 00:01:37,161 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-04 00:01:37,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$2(1952): Client=jenkins//188.40.62.62 merge regions 8711e917be437d73700501af5126a69b, 57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:37,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8711e917be437d73700501af5126a69b, 57f9574b5a22a1cc2210ff96e09515b5], force=true 2023-10-04 00:01:37,198 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8711e917be437d73700501af5126a69b, 57f9574b5a22a1cc2210ff96e09515b5], force=true 2023-10-04 00:01:37,198 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8711e917be437d73700501af5126a69b, 57f9574b5a22a1cc2210ff96e09515b5], force=true 2023-10-04 00:01:37,198 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8711e917be437d73700501af5126a69b, 57f9574b5a22a1cc2210ff96e09515b5], force=true 2023-10-04 00:01:37,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 00:01:37,220 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8711e917be437d73700501af5126a69b, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57f9574b5a22a1cc2210ff96e09515b5, UNASSIGN}] 2023-10-04 00:01:37,223 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8711e917be437d73700501af5126a69b, UNASSIGN 2023-10-04 00:01:37,223 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57f9574b5a22a1cc2210ff96e09515b5, UNASSIGN 2023-10-04 00:01:37,224 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=8711e917be437d73700501af5126a69b, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:37,224 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=57f9574b5a22a1cc2210ff96e09515b5, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:37,224 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696377697224"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377697224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377697224"}]},"ts":"1696377697224"} 2023-10-04 00:01:37,224 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696377697224"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377697224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377697224"}]},"ts":"1696377697224"} 2023-10-04 00:01:37,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 57f9574b5a22a1cc2210ff96e09515b5, server=jenkins-hbase16.apache.org,43449,1696377627431}] 2023-10-04 00:01:37,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 8711e917be437d73700501af5126a69b, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:01:37,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 00:01:37,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 8711e917be437d73700501af5126a69b 2023-10-04 00:01:37,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:37,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 8711e917be437d73700501af5126a69b, disabling compactions & flushes 2023-10-04 00:01:37,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:37,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:37,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. after waiting 0 ms 2023-10-04 00:01:37,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:37,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 57f9574b5a22a1cc2210ff96e09515b5, disabling compactions & flushes 2023-10-04 00:01:37,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing 8711e917be437d73700501af5126a69b 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-04 00:01:37,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:37,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:37,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. after waiting 0 ms 2023-10-04 00:01:37,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:37,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing 57f9574b5a22a1cc2210ff96e09515b5 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-04 00:01:37,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/.tmp/cf/5e50689990994cdb97d603eb8542eef3 2023-10-04 00:01:37,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/.tmp/cf/a41cad5c688d4b09b161ac9b971c6a34 2023-10-04 00:01:37,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/.tmp/cf/a41cad5c688d4b09b161ac9b971c6a34 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/cf/a41cad5c688d4b09b161ac9b971c6a34 2023-10-04 00:01:37,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/.tmp/cf/5e50689990994cdb97d603eb8542eef3 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/cf/5e50689990994cdb97d603eb8542eef3 2023-10-04 00:01:37,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/cf/5e50689990994cdb97d603eb8542eef3, entries=1, sequenceid=5, filesize=4.7 K 2023-10-04 00:01:37,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/cf/a41cad5c688d4b09b161ac9b971c6a34, entries=1, sequenceid=5, filesize=4.7 K 2023-10-04 00:01:37,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 8711e917be437d73700501af5126a69b in 24ms, sequenceid=5, compaction requested=false 2023-10-04 00:01:37,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 57f9574b5a22a1cc2210ff96e09515b5 in 23ms, sequenceid=5, compaction requested=false 2023-10-04 00:01:37,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 00:01:37,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 00:01:37,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-04 00:01:37,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-04 00:01:37,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:01:37,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:01:37,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b. 2023-10-04 00:01:37,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5. 2023-10-04 00:01:37,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 8711e917be437d73700501af5126a69b: 2023-10-04 00:01:37,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 57f9574b5a22a1cc2210ff96e09515b5: 2023-10-04 00:01:37,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:37,417 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=57f9574b5a22a1cc2210ff96e09515b5, regionState=CLOSED 2023-10-04 00:01:37,417 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696377697417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377697417"}]},"ts":"1696377697417"} 2023-10-04 00:01:37,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 8711e917be437d73700501af5126a69b 2023-10-04 00:01:37,418 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=8711e917be437d73700501af5126a69b, regionState=CLOSED 2023-10-04 00:01:37,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696377697417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377697417"}]},"ts":"1696377697417"} 2023-10-04 00:01:37,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-04 00:01:37,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 57f9574b5a22a1cc2210ff96e09515b5, server=jenkins-hbase16.apache.org,43449,1696377627431 in 193 msec 2023-10-04 00:01:37,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-04 00:01:37,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 8711e917be437d73700501af5126a69b, server=jenkins-hbase16.apache.org,44307,1696377627472 in 193 msec 2023-10-04 00:01:37,421 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57f9574b5a22a1cc2210ff96e09515b5, UNASSIGN in 200 msec 2023-10-04 00:01:37,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-04 00:01:37,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8711e917be437d73700501af5126a69b, UNASSIGN in 204 msec 2023-10-04 00:01:37,461 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-04 00:01:37,463 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696547.8711e917be437d73700501af5126a69b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:37,463 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696377696547.57f9574b5a22a1cc2210ff96e09515b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:37,463 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:37,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cdca07e0bc39cee25eb5206aa1fe7f1a, ASSIGN}] 2023-10-04 00:01:37,503 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cdca07e0bc39cee25eb5206aa1fe7f1a, ASSIGN 2023-10-04 00:01:37,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 00:01:37,504 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cdca07e0bc39cee25eb5206aa1fe7f1a, ASSIGN; state=MERGED, location=jenkins-hbase16.apache.org,44307,1696377627472; forceNewPlan=false, retain=false 2023-10-04 00:01:37,654 INFO [jenkins-hbase16:34927] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 00:01:37,658 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=cdca07e0bc39cee25eb5206aa1fe7f1a, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:37,658 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696377697658"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377697658"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377697658"}]},"ts":"1696377697658"} 2023-10-04 00:01:37,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure cdca07e0bc39cee25eb5206aa1fe7f1a, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:01:37,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 00:01:37,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. 2023-10-04 00:01:37,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cdca07e0bc39cee25eb5206aa1fe7f1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.', STARTKEY => '', ENDKEY => ''} 2023-10-04 00:01:37,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. service=AccessControlService 2023-10-04 00:01:37,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:01:37,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:37,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:37,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:37,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:37,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/.regioninfo 2023-10-04 00:01:37,838 INFO [StoreOpener-cdca07e0bc39cee25eb5206aa1fe7f1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:37,839 DEBUG [StoreOpener-cdca07e0bc39cee25eb5206aa1fe7f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf 2023-10-04 00:01:37,839 DEBUG [StoreOpener-cdca07e0bc39cee25eb5206aa1fe7f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf 2023-10-04 00:01:37,840 INFO [StoreOpener-cdca07e0bc39cee25eb5206aa1fe7f1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cdca07e0bc39cee25eb5206aa1fe7f1a columnFamilyName cf 2023-10-04 00:01:37,864 DEBUG [StoreOpener-cdca07e0bc39cee25eb5206aa1fe7f1a-1] regionserver.HStore(539): loaded hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf/5e50689990994cdb97d603eb8542eef3.8711e917be437d73700501af5126a69b->hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/cf/5e50689990994cdb97d603eb8542eef3-top 2023-10-04 00:01:37,870 DEBUG [StoreOpener-cdca07e0bc39cee25eb5206aa1fe7f1a-1] regionserver.HStore(539): loaded hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf/a41cad5c688d4b09b161ac9b971c6a34.57f9574b5a22a1cc2210ff96e09515b5->hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/cf/a41cad5c688d4b09b161ac9b971c6a34-top 2023-10-04 00:01:37,871 INFO [StoreOpener-cdca07e0bc39cee25eb5206aa1fe7f1a-1] regionserver.HStore(310): Store=cdca07e0bc39cee25eb5206aa1fe7f1a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:01:37,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:37,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:37,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:37,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened cdca07e0bc39cee25eb5206aa1fe7f1a; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73580014, jitterRate=0.09642764925956726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:01:37,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for cdca07e0bc39cee25eb5206aa1fe7f1a: 2023-10-04 00:01:37,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a., pid=77, masterSystemTime=1696377697817 2023-10-04 00:01:37,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.,because compaction is disabled. 2023-10-04 00:01:37,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. 2023-10-04 00:01:37,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. 2023-10-04 00:01:37,878 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=cdca07e0bc39cee25eb5206aa1fe7f1a, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:37,879 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696377697878"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377697878"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377697878"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377697878"}]},"ts":"1696377697878"} 2023-10-04 00:01:37,882 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-04 00:01:37,882 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure cdca07e0bc39cee25eb5206aa1fe7f1a, server=jenkins-hbase16.apache.org,44307,1696377627472 in 217 msec 2023-10-04 00:01:37,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-04 00:01:37,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cdca07e0bc39cee25eb5206aa1fe7f1a, ASSIGN in 380 msec 2023-10-04 00:01:37,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[8711e917be437d73700501af5126a69b, 57f9574b5a22a1cc2210ff96e09515b5], force=true in 692 msec 2023-10-04 00:01:38,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 00:01:38,309 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-04 00:01:38,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 00:01:38,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377698312 (current time:1696377698312). 2023-10-04 00:01:38,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:01:38,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x45ea9ea6 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:38,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45128d03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:38,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:38,361 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:38,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45ea9ea6 to 127.0.0.1:51489 2023-10-04 00:01:38,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:38,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x39503f28 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:38,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@285e990a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:38,386 DEBUG [hconnection-0x79756397-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:38,391 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:38,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:38,398 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:38,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39503f28 to 127.0.0.1:51489 2023-10-04 00:01:38,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:38,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-04 00:01:38,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:01:38,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 00:01:38,402 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:01:38,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 00:01:38,405 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 00:01:38,405 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696378298405 2023-10-04 00:01:38,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 00:01:38,405 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,409 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:01:38,409 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:01:38,410 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 00:01:38,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 00:01:38,411 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-04 00:01:38,412 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 00:01:38,412 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696378298412 2023-10-04 00:01:38,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,421 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 00:01:38,421 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:38,422 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-04 00:01:38,422 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-04 00:01:38,423 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,423 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,432 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:38,432 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:38,432 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:38,432 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:38,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:38,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,432 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,433 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 00:01:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,433 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 00:01:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 00:01:38,434 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 00:01:38,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,434 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 00:01:38,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,434 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:38,434 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 00:01:38,434 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:38,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 00:01:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 00:01:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 00:01:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 00:01:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 00:01:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 00:01:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 00:01:38,436 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:38,437 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 00:01:38,437 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 00:01:38,438 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 00:01:38,447 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,455 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,455 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,455 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,455 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,456 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:38,456 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,456 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:38,456 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,456 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:38,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:38,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:38,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:38,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-04 00:01:38,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ac7b917[Count = 0] remaining members to acquire global barrier 2023-10-04 00:01:38,458 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-04 00:01:38,458 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,465 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,465 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,465 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,466 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 00:01:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,466 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 00:01:38,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,466 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,466 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:01:38,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,466 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:01:38,466 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 00:01:38,466 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 00:01:38,466 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 00:01:38,466 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:01:38,466 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:38,466 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:38,466 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. 2023-10-04 00:01:38,467 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. started... 2023-10-04 00:01:38,468 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cdca07e0bc39cee25eb5206aa1fe7f1a: 2023-10-04 00:01:38,469 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,469 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:38,469 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf/5e50689990994cdb97d603eb8542eef3.8711e917be437d73700501af5126a69b->hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/cf/5e50689990994cdb97d603eb8542eef3-top, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf/a41cad5c688d4b09b161ac9b971c6a34.57f9574b5a22a1cc2210ff96e09515b5->hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/cf/a41cad5c688d4b09b161ac9b971c6a34-top] hfiles 2023-10-04 00:01:38,469 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf/5e50689990994cdb97d603eb8542eef3.8711e917be437d73700501af5126a69b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,470 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf/a41cad5c688d4b09b161ac9b971c6a34.57f9574b5a22a1cc2210ff96e09515b5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,474 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 00:01:38,474 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:38,474 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 00:01:38,482 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. completed. 2023-10-04 00:01:38,482 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. 2023-10-04 00:01:38,482 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:38,482 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:38,482 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,482 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 00:01:38,482 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 00:01:38,482 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:38,482 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 00:01:38,482 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:01:38,510 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:38,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-04 00:01:38,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:01:38,512 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:01:38,518 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 00:01:38,518 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:38,518 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,518 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 00:01:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:38,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:38,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:38,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:38,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase16.apache.org,44307,1696377627472': 2023-10-04 00:01:38,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-04 00:01:38,528 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-04 00:01:38,528 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:01:38,528 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:01:38,528 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,528 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:01:38,540 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,540 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:38,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,540 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,540 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,540 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,541 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,541 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:38,541 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:38,542 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,542 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:38,543 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,543 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:38,543 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:38,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:38,549 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:38,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:38,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:38,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:38,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:38,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:38,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:38,549 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,550 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:38,550 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,550 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:38,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:38,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:38,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:38,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:38,550 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:38,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:38,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:38,550 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,550 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-04 00:01:38,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,569 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696377698406Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696377698549 (+143 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696377698549Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696377698552 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696377698562 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696377698569 (+7 ms) 2023-10-04 00:01:38,572 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 00:01:38,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 163 msec 2023-10-04 00:01:38,712 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:38,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-04 00:01:38,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:01:38,713 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377698713 2023-10-04 00:01:38,714 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43845, tgtDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377698713, rawTgtDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377698713, srcFsUri=hdfs://localhost:43845, srcDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:01:38,730 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:01:38,730 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-626379672_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377698713, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377698713/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,730 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d, snapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-04 00:01:38,737 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377698713/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:38,755 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:38,756 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:38,756 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:38,756 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:38,844 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0004_000001 (auth:SIMPLE) 2023-10-04 00:01:39,458 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-6634423066230258810.jar 2023-10-04 00:01:39,458 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:39,459 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:39,511 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-6309363512137135570.jar 2023-10-04 00:01:39,511 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:39,512 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:39,512 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:39,512 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:39,512 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:39,513 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:39,513 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 00:01:39,513 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 00:01:39,514 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 00:01:39,514 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 00:01:39,514 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 00:01:39,515 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 00:01:39,515 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 00:01:39,515 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 00:01:39,515 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 00:01:39,516 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 00:01:39,516 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:39,516 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:39,517 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:39,517 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:39,517 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:39,518 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:39,518 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:40,287 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 00:01:40,304 WARN [Listener at jenkins-hbase16.apache.org/38813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 00:01:40,306 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-04 00:01:40,309 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-04 00:01:40,391 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:01:40,391 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:01:40,622 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0005_000001 (auth:SIMPLE) 2023-10-04 00:01:43,960 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0005_000001 (auth:SIMPLE) 2023-10-04 00:01:46,162 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0005_000001 (auth:SIMPLE) 2023-10-04 00:01:48,149 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0005_000001 (auth:SIMPLE) 2023-10-04 00:01:48,160 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696377633735_0005_01_000002 is : 143 2023-10-04 00:01:49,515 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 00:01:49,516 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 00:01:49,523 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,524 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 00:01:49,524 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 00:01:49,524 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,525 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-04 00:01:49,525 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-04 00:01:49,525 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377698713/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377698713/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,525 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377698713/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-04 00:01:49,525 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377698713/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-04 00:01:49,531 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 00:01:49,535 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377709535"}]},"ts":"1696377709535"} 2023-10-04 00:01:49,537 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-04 00:01:49,565 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-04 00:01:49,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cdca07e0bc39cee25eb5206aa1fe7f1a, UNASSIGN}] 2023-10-04 00:01:49,568 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cdca07e0bc39cee25eb5206aa1fe7f1a, UNASSIGN 2023-10-04 00:01:49,569 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=cdca07e0bc39cee25eb5206aa1fe7f1a, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:49,569 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696377709569"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377709569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377709569"}]},"ts":"1696377709569"} 2023-10-04 00:01:49,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure cdca07e0bc39cee25eb5206aa1fe7f1a, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:01:49,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 00:01:49,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:49,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing cdca07e0bc39cee25eb5206aa1fe7f1a, disabling compactions & flushes 2023-10-04 00:01:49,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. 2023-10-04 00:01:49,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. 2023-10-04 00:01:49,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. after waiting 0 ms 2023-10-04 00:01:49,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. 2023-10-04 00:01:49,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-04 00:01:49,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:01:49,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a. 2023-10-04 00:01:49,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for cdca07e0bc39cee25eb5206aa1fe7f1a: 2023-10-04 00:01:49,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:49,743 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=cdca07e0bc39cee25eb5206aa1fe7f1a, regionState=CLOSED 2023-10-04 00:01:49,743 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696377709743"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377709743"}]},"ts":"1696377709743"} 2023-10-04 00:01:49,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-04 00:01:49,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure cdca07e0bc39cee25eb5206aa1fe7f1a, server=jenkins-hbase16.apache.org,44307,1696377627472 in 173 msec 2023-10-04 00:01:49,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-04 00:01:49,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cdca07e0bc39cee25eb5206aa1fe7f1a, UNASSIGN in 180 msec 2023-10-04 00:01:49,748 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377709748"}]},"ts":"1696377709748"} 2023-10-04 00:01:49,749 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-04 00:01:49,756 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-04 00:01:49,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 226 msec 2023-10-04 00:01:49,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 00:01:49,839 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-04 00:01:49,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,847 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,848 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,850 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,854 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:49,854 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b 2023-10-04 00:01:49,854 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:49,856 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/recovered.edits] 2023-10-04 00:01:49,857 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/recovered.edits] 2023-10-04 00:01:49,857 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/recovered.edits] 2023-10-04 00:01:49,860 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf/5e50689990994cdb97d603eb8542eef3.8711e917be437d73700501af5126a69b to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf/5e50689990994cdb97d603eb8542eef3.8711e917be437d73700501af5126a69b 2023-10-04 00:01:49,860 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/cf/a41cad5c688d4b09b161ac9b971c6a34 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/cf/a41cad5c688d4b09b161ac9b971c6a34 2023-10-04 00:01:49,861 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/cf/5e50689990994cdb97d603eb8542eef3 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/cf/5e50689990994cdb97d603eb8542eef3 2023-10-04 00:01:49,861 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf/a41cad5c688d4b09b161ac9b971c6a34.57f9574b5a22a1cc2210ff96e09515b5 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/cf/a41cad5c688d4b09b161ac9b971c6a34.57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:49,863 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/recovered.edits/8.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5/recovered.edits/8.seqid 2023-10-04 00:01:49,864 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/recovered.edits/8.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b/recovered.edits/8.seqid 2023-10-04 00:01:49,864 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57f9574b5a22a1cc2210ff96e09515b5 2023-10-04 00:01:49,864 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8711e917be437d73700501af5126a69b 2023-10-04 00:01:49,864 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/recovered.edits/12.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a/recovered.edits/12.seqid 2023-10-04 00:01:49,865 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cdca07e0bc39cee25eb5206aa1fe7f1a 2023-10-04 00:01:49,865 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-04 00:01:49,866 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,866 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,866 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,866 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-04 00:01:49,866 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-04 00:01:49,866 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-04 00:01:49,868 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,868 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,868 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-04 00:01:49,870 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-04 00:01:49,871 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-04 00:01:49,872 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,872 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-04 00:01:49,873 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377709873"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:49,873 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,873 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,873 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,873 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,873 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:49,873 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:49,873 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:49,873 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:49,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-04 00:01:49,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:49,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:49,874 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-04 00:01:49,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:49,874 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cdca07e0bc39cee25eb5206aa1fe7f1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696377696548.cdca07e0bc39cee25eb5206aa1fe7f1a.', STARTKEY => '', ENDKEY => ''}] 2023-10-04 00:01:49,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:49,875 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-04 00:01:49,875 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696377709875"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:49,876 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-04 00:01:49,882 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:49,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 41 msec 2023-10-04 00:01:49,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-04 00:01:49,977 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-04 00:01:49,978 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:49,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:49,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:49,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 00:01:49,987 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377709987"}]},"ts":"1696377709987"} 2023-10-04 00:01:49,988 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-04 00:01:49,998 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-04 00:01:49,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31dd95ac9f7e45ff17c0b15b6fa513e8, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e827086b0687356c74e4e2731943d416, UNASSIGN}] 2023-10-04 00:01:50,001 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31dd95ac9f7e45ff17c0b15b6fa513e8, UNASSIGN 2023-10-04 00:01:50,001 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e827086b0687356c74e4e2731943d416, UNASSIGN 2023-10-04 00:01:50,002 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=31dd95ac9f7e45ff17c0b15b6fa513e8, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:50,002 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=e827086b0687356c74e4e2731943d416, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:50,002 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696377710002"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377710002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377710002"}]},"ts":"1696377710002"} 2023-10-04 00:01:50,003 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696377710002"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377710002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377710002"}]},"ts":"1696377710002"} 2023-10-04 00:01:50,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 31dd95ac9f7e45ff17c0b15b6fa513e8, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:01:50,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure e827086b0687356c74e4e2731943d416, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:01:50,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 00:01:50,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:50,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close e827086b0687356c74e4e2731943d416 2023-10-04 00:01:50,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 31dd95ac9f7e45ff17c0b15b6fa513e8, disabling compactions & flushes 2023-10-04 00:01:50,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:50,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:50,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. after waiting 0 ms 2023-10-04 00:01:50,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:50,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing e827086b0687356c74e4e2731943d416, disabling compactions & flushes 2023-10-04 00:01:50,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:50,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:50,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. after waiting 0 ms 2023-10-04 00:01:50,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:50,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:01:50,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:01:50,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:01:50,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416. 2023-10-04 00:01:50,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for e827086b0687356c74e4e2731943d416: 2023-10-04 00:01:50,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:01:50,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8. 2023-10-04 00:01:50,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 31dd95ac9f7e45ff17c0b15b6fa513e8: 2023-10-04 00:01:50,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed e827086b0687356c74e4e2731943d416 2023-10-04 00:01:50,177 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=e827086b0687356c74e4e2731943d416, regionState=CLOSED 2023-10-04 00:01:50,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:50,177 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696377710177"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377710177"}]},"ts":"1696377710177"} 2023-10-04 00:01:50,178 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=31dd95ac9f7e45ff17c0b15b6fa513e8, regionState=CLOSED 2023-10-04 00:01:50,178 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696377710178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377710178"}]},"ts":"1696377710178"} 2023-10-04 00:01:50,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-04 00:01:50,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure e827086b0687356c74e4e2731943d416, server=jenkins-hbase16.apache.org,44307,1696377627472 in 172 msec 2023-10-04 00:01:50,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-04 00:01:50,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 31dd95ac9f7e45ff17c0b15b6fa513e8, server=jenkins-hbase16.apache.org,41265,1696377627379 in 175 msec 2023-10-04 00:01:50,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e827086b0687356c74e4e2731943d416, UNASSIGN in 181 msec 2023-10-04 00:01:50,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-10-04 00:01:50,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31dd95ac9f7e45ff17c0b15b6fa513e8, UNASSIGN in 181 msec 2023-10-04 00:01:50,181 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377710181"}]},"ts":"1696377710181"} 2023-10-04 00:01:50,182 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-04 00:01:50,190 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-04 00:01:50,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 210 msec 2023-10-04 00:01:50,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 00:01:50,293 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-04 00:01:50,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,301 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,303 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,307 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:50,307 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416 2023-10-04 00:01:50,309 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/recovered.edits] 2023-10-04 00:01:50,309 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/recovered.edits] 2023-10-04 00:01:50,315 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/cf/c29d2d2120a84f2eb68c9b4587f83609 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/cf/c29d2d2120a84f2eb68c9b4587f83609 2023-10-04 00:01:50,315 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/cf/915253aacdec43e4ab39f54da022a169 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/cf/915253aacdec43e4ab39f54da022a169 2023-10-04 00:01:50,317 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8/recovered.edits/9.seqid 2023-10-04 00:01:50,317 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416/recovered.edits/9.seqid 2023-10-04 00:01:50,318 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31dd95ac9f7e45ff17c0b15b6fa513e8 2023-10-04 00:01:50,318 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e827086b0687356c74e4e2731943d416 2023-10-04 00:01:50,318 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-04 00:01:50,318 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-04 00:01:50,319 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-04 00:01:50,321 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100414e725af18804b209552d38fbb5ab1e0 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100414e725af18804b209552d38fbb5ab1e0 2023-10-04 00:01:50,322 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023100462cd63c0304145808a504635baecbd48 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023100462cd63c0304145808a504635baecbd48 2023-10-04 00:01:50,323 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-04 00:01:50,323 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,323 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,323 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,323 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 00:01:50,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 00:01:50,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 00:01:50,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 00:01:50,325 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,326 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-04 00:01:50,328 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-04 00:01:50,330 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,330 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-04 00:01:50,330 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377710330"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:50,330 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377710330"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:50,331 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 00:01:50,331 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 31dd95ac9f7e45ff17c0b15b6fa513e8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696377695113.31dd95ac9f7e45ff17c0b15b6fa513e8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e827086b0687356c74e4e2731943d416, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696377695113.e827086b0687356c74e4e2731943d416.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 00:01:50,331 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,331 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-04 00:01:50,331 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,332 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:50,331 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696377710332"}]},"ts":"9223372036854775807"} 2023-10-04 00:01:50,332 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,332 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:50,332 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:50,332 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:50,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-04 00:01:50,333 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-04 00:01:50,340 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 46 msec 2023-10-04 00:01:50,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-04 00:01:50,435 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-04 00:01:50,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-04 00:01:50,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-04 00:01:50,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 00:01:50,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-04 00:01:50,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 00:01:50,484 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763 (was 759) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4068 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_955129651_17 at /127.0.0.1:59314 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_955129651_17 at /127.0.0.1:36282 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_955129651_17 at /127.0.0.1:59970 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase16.apache.org/188.40.62.62:35589 from appattempt_1696377633735_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2090954783_1 at /127.0.0.1:36268 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (748961003) connection to jenkins-hbase16.apache.org/188.40.62.62:40141 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_955129651_17 at /127.0.0.1:36292 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2090954783_1 at /127.0.0.1:59308 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74eaffc3-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 267), ProcessCount=171 (was 171), AvailableMemoryMB=4320 (was 4382) 2023-10-04 00:01:50,485 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-04 00:01:50,504 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=247, ProcessCount=171, AvailableMemoryMB=4319 2023-10-04 00:01:50,504 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-04 00:01:50,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 00:01:50,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 00:01:50,508 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 00:01:50,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-04 00:01:50,509 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 00:01:50,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 00:01:50,511 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:01:50,511 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:01:50,511 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba empty. 2023-10-04 00:01:50,511 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce empty. 2023-10-04 00:01:50,512 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:01:50,512 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:01:50,512 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-04 00:01:50,524 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-04 00:01:50,525 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5045aa51eb45b466698873fbe475d4ba, NAME => 'testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:01:50,525 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1b972a001f88a12e94ea76045c7662ce, NAME => 'testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5045aa51eb45b466698873fbe475d4ba, disabling compactions & flushes 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 1b972a001f88a12e94ea76045c7662ce, disabling compactions & flushes 2023-10-04 00:01:50,549 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:50,549 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. after waiting 0 ms 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. after waiting 0 ms 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:50,549 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:50,549 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 1b972a001f88a12e94ea76045c7662ce: 2023-10-04 00:01:50,549 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5045aa51eb45b466698873fbe475d4ba: 2023-10-04 00:01:50,551 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 00:01:50,552 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696377710552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377710552"}]},"ts":"1696377710552"} 2023-10-04 00:01:50,552 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696377710552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377710552"}]},"ts":"1696377710552"} 2023-10-04 00:01:50,554 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 00:01:50,555 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 00:01:50,555 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377710555"}]},"ts":"1696377710555"} 2023-10-04 00:01:50,556 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-04 00:01:50,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 00:01:50,649 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-10-04 00:01:50,652 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 00:01:50,652 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 00:01:50,652 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 00:01:50,653 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 00:01:50,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b972a001f88a12e94ea76045c7662ce, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5045aa51eb45b466698873fbe475d4ba, ASSIGN}] 2023-10-04 00:01:50,657 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5045aa51eb45b466698873fbe475d4ba, ASSIGN 2023-10-04 00:01:50,657 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b972a001f88a12e94ea76045c7662ce, ASSIGN 2023-10-04 00:01:50,658 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5045aa51eb45b466698873fbe475d4ba, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,41265,1696377627379; forceNewPlan=false, retain=false 2023-10-04 00:01:50,658 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b972a001f88a12e94ea76045c7662ce, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,44307,1696377627472; forceNewPlan=false, retain=false 2023-10-04 00:01:50,808 INFO [jenkins-hbase16:34927] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 00:01:50,814 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1b972a001f88a12e94ea76045c7662ce, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:50,814 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=5045aa51eb45b466698873fbe475d4ba, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:50,814 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696377710814"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377710814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377710814"}]},"ts":"1696377710814"} 2023-10-04 00:01:50,814 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696377710814"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377710814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377710814"}]},"ts":"1696377710814"} 2023-10-04 00:01:50,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 00:01:50,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 1b972a001f88a12e94ea76045c7662ce, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:01:50,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 5045aa51eb45b466698873fbe475d4ba, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:01:50,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:50,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:50,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b972a001f88a12e94ea76045c7662ce, NAME => 'testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 00:01:50,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5045aa51eb45b466698873fbe475d4ba, NAME => 'testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 00:01:50,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. service=AccessControlService 2023-10-04 00:01:50,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. service=AccessControlService 2023-10-04 00:01:50,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:01:50,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:01:50,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:01:50,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:01:50,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:50,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:01:50,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:01:50,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:01:50,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:01:50,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:01:50,979 INFO [StoreOpener-5045aa51eb45b466698873fbe475d4ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:01:50,979 INFO [StoreOpener-1b972a001f88a12e94ea76045c7662ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:01:50,981 DEBUG [StoreOpener-1b972a001f88a12e94ea76045c7662ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/cf 2023-10-04 00:01:50,981 DEBUG [StoreOpener-1b972a001f88a12e94ea76045c7662ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/cf 2023-10-04 00:01:50,981 DEBUG [StoreOpener-5045aa51eb45b466698873fbe475d4ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/cf 2023-10-04 00:01:50,982 DEBUG [StoreOpener-5045aa51eb45b466698873fbe475d4ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/cf 2023-10-04 00:01:50,982 INFO [StoreOpener-1b972a001f88a12e94ea76045c7662ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b972a001f88a12e94ea76045c7662ce columnFamilyName cf 2023-10-04 00:01:50,982 INFO [StoreOpener-5045aa51eb45b466698873fbe475d4ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5045aa51eb45b466698873fbe475d4ba columnFamilyName cf 2023-10-04 00:01:50,983 INFO [StoreOpener-1b972a001f88a12e94ea76045c7662ce-1] regionserver.HStore(310): Store=1b972a001f88a12e94ea76045c7662ce/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:01:50,983 INFO [StoreOpener-5045aa51eb45b466698873fbe475d4ba-1] regionserver.HStore(310): Store=5045aa51eb45b466698873fbe475d4ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:01:50,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:01:50,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:01:50,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:01:50,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:01:50,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:01:50,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:01:50,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:01:50,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:01:50,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 5045aa51eb45b466698873fbe475d4ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70935820, jitterRate=0.05702608823776245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:01:50,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 1b972a001f88a12e94ea76045c7662ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71937154, jitterRate=0.0719471275806427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:01:50,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 5045aa51eb45b466698873fbe475d4ba: 2023-10-04 00:01:50,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 1b972a001f88a12e94ea76045c7662ce: 2023-10-04 00:01:50,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce., pid=93, masterSystemTime=1696377710968 2023-10-04 00:01:50,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba., pid=94, masterSystemTime=1696377710968 2023-10-04 00:01:50,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:50,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:50,991 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1b972a001f88a12e94ea76045c7662ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:50,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:50,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:50,991 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696377710991"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377710991"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377710991"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377710991"}]},"ts":"1696377710991"} 2023-10-04 00:01:50,991 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=5045aa51eb45b466698873fbe475d4ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:50,991 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696377710991"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377710991"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377710991"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377710991"}]},"ts":"1696377710991"} 2023-10-04 00:01:50,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-04 00:01:50,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 1b972a001f88a12e94ea76045c7662ce, server=jenkins-hbase16.apache.org,44307,1696377627472 in 176 msec 2023-10-04 00:01:50,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-10-04 00:01:50,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 5045aa51eb45b466698873fbe475d4ba, server=jenkins-hbase16.apache.org,41265,1696377627379 in 176 msec 2023-10-04 00:01:50,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b972a001f88a12e94ea76045c7662ce, ASSIGN in 340 msec 2023-10-04 00:01:50,996 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-04 00:01:50,996 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5045aa51eb45b466698873fbe475d4ba, ASSIGN in 341 msec 2023-10-04 00:01:50,996 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 00:01:50,996 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377710996"}]},"ts":"1696377710996"} 2023-10-04 00:01:50,997 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-04 00:01:51,033 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 00:01:51,033 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-04 00:01:51,036 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 00:01:51,047 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:51,047 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:51,047 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:51,047 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:01:51,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:51,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:51,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:51,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 00:01:51,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 552 msec 2023-10-04 00:01:51,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 00:01:51,118 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-04 00:01:51,121 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-04 00:01:51,122 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:51,125 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:01:51,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:01:51,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377711137 (current time:1696377711137). 2023-10-04 00:01:51,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:01:51,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x04efced0 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:51,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65e490cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:51,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:51,156 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:51,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04efced0 to 127.0.0.1:51489 2023-10-04 00:01:51,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:51,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x01e49c3a to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:51,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b874b98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:51,177 DEBUG [hconnection-0x3aa4cedd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:51,182 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:51,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:51,193 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:51,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01e49c3a to 127.0.0.1:51489 2023-10-04 00:01:51,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:51,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 00:01:51,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:01:51,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:01:51,199 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:01:51,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:01:51,207 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:01:51,208 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696378311208 2023-10-04 00:01:51,208 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-04 00:01:51,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:01:51,210 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:01:51,210 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:01:51,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 00:01:51,211 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:01:51,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-04 00:01:51,216 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 00:01:51,217 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696378311217 2023-10-04 00:01:51,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,226 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-04 00:01:51,226 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:51,227 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-04 00:01:51,227 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-04 00:01:51,228 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,228 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,258 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,258 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,258 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,258 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,259 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,259 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,259 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,259 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:01:51,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 00:01:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 00:01:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,260 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 00:01:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 00:01:51,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,260 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 00:01:51,260 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 00:01:51,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,261 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 00:01:51,261 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 00:01:51,261 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:51,261 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:51,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,263 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 00:01:51,263 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 00:01:51,263 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 00:01:51,263 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:51,263 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 00:01:51,264 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 00:01:51,264 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 00:01:51,265 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 00:01:51,264 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 00:01:51,265 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 00:01:51,265 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 00:01:51,273 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,273 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:51,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:51,281 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:51,282 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,282 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:51,281 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,281 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,282 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:51,282 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:51,282 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,282 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 00:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51ea46f5[Count = 1] remaining members to acquire global barrier 2023-10-04 00:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:51,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 00:01:51,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51ea46f5[Count = 0] remaining members to acquire global barrier 2023-10-04 00:01:51,285 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 00:01:51,285 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,290 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,290 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,290 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,290 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:01:51,290 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,290 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:01:51,290 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:51,290 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,290 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. started... 2023-10-04 00:01:51,290 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:51,290 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:01:51,290 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 00:01:51,290 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:01:51,291 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:01:51,291 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:51,292 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5045aa51eb45b466698873fbe475d4ba: 2023-10-04 00:01:51,292 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:51,292 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:51,292 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:51,292 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,292 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. started... 2023-10-04 00:01:51,292 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:51,292 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:01:51,292 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1b972a001f88a12e94ea76045c7662ce: 2023-10-04 00:01:51,292 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,292 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:51,292 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:01:51,301 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 00:01:51,301 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:51,301 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 00:01:51,304 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. completed. 2023-10-04 00:01:51,304 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. completed. 2023-10-04 00:01:51,304 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:51,304 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:51,304 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:51,304 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:51,304 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:51,304 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,304 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:51,304 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 00:01:51,304 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,304 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:01:51,304 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 00:01:51,304 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:01:51,310 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:51,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 00:01:51,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:01:51,311 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:01:51,315 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 00:01:51,315 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,315 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:51,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:51,315 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 00:01:51,323 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,323 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 00:01:51,323 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:51,323 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 00:01:51,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:51,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:51,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:51,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase16.apache.org,44307,1696377627472': 2023-10-04 00:01:51,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 00:01:51,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:51,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:51,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:51,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:51,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:51,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase16.apache.org,41265,1696377627379': 2023-10-04 00:01:51,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 00:01:51,338 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-04 00:01:51,338 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:01:51,338 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:01:51,338 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,338 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:01:51,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,349 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:51,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:51,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,349 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,350 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:51,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,351 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,352 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:51,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,355 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:51,356 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,356 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,365 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,365 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,365 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,365 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,365 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,365 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:51,365 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,365 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,368 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,368 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,365 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,365 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,368 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,368 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,368 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,368 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,368 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-04 00:01:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,368 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,369 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:01:51,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 00:01:51,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-04 00:01:51,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,399 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696377711208Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696377711379 (+171 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696377711379Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696377711379Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696377711383 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696377711392 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696377711398 (+6 ms) 2023-10-04 00:01:51,402 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 00:01:51,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 193 msec 2023-10-04 00:01:51,511 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:51,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 00:01:51,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:01:51,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44307] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:01:51,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41265] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:01:51,524 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-04 00:01:51,524 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:51,524 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:01:51,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:01:51,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377711537 (current time:1696377711537). 2023-10-04 00:01:51,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:01:51,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x54f280d7 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:51,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1210da98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:51,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:51,553 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:51,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54f280d7 to 127.0.0.1:51489 2023-10-04 00:01:51,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:51,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x79bbf189 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:01:51,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@398f2251, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:01:51,575 DEBUG [hconnection-0x2ddffbe2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:51,576 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:41108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:51,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:01:51,581 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:33036, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:01:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79bbf189 to 127.0.0.1:51489 2023-10-04 00:01:51,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:01:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 00:01:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:01:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:01:51,586 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:01:51,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:01:51,588 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:01:51,589 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696378311589 2023-10-04 00:01:51,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-04 00:01:51,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 00:01:51,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 00:01:51,592 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 00:01:51,592 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:01:51,592 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:01:51,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-04 00:01:51,594 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 00:01:51,595 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696378311595 2023-10-04 00:01:51,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,602 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-04 00:01:51,602 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:51,603 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-04 00:01:51,603 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-04 00:01:51,604 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,604 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,613 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,613 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,613 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,613 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,614 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,614 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,614 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,614 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 00:01:51,614 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 00:01:51,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,615 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 00:01:51,615 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 00:01:51,615 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:51,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,616 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 00:01:51,616 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 00:01:51,616 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:51,615 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:01:51,617 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 00:01:51,620 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 00:01:51,616 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 00:01:51,620 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 00:01:51,620 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 00:01:51,620 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 00:01:51,620 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 00:01:51,620 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 00:01:51,630 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,630 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,630 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:51,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:51,659 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,660 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:51,660 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,660 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:51,660 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,660 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:51,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:51,661 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,661 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:01:51,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:51,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 00:01:51,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5daad48f[Count = 1] remaining members to acquire global barrier 2023-10-04 00:01:51,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:51,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:51,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:51,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:51,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:51,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 00:01:51,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5daad48f[Count = 0] remaining members to acquire global barrier 2023-10-04 00:01:51,670 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 00:01:51,671 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,682 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,682 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,682 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,682 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:01:51,682 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,683 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:51,683 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:51,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,682 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:01:51,683 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 00:01:51,683 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:01:51,683 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:01:51,683 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:51,683 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:51,684 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. started... 2023-10-04 00:01:51,683 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. started... 2023-10-04 00:01:51,683 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 00:01:51,683 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,684 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:01:51,684 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1b972a001f88a12e94ea76045c7662ce 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-04 00:01:51,684 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5045aa51eb45b466698873fbe475d4ba 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-04 00:01:51,684 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:01:51,690 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 00:01:51,690 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:51,690 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 00:01:51,692 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:51,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 00:01:51,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:01:51,694 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:01:51,708 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004d2c37339dbca4f60a3e41df58d0e40f3 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004d2c37339dbca4f60a3e41df58d0e40f3 2023-10-04 00:01:51,708 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100435b627e38ae349e280796f6178c806c2 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023100435b627e38ae349e280796f6178c806c2 2023-10-04 00:01:51,720 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/.tmp/cf/392bc499c4cb4c31b4d27125b9bbd692 2023-10-04 00:01:51,721 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/.tmp/cf/6abbb91a21d34de98154644d96830aaa 2023-10-04 00:01:51,725 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/.tmp/cf/392bc499c4cb4c31b4d27125b9bbd692 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/cf/392bc499c4cb4c31b4d27125b9bbd692 2023-10-04 00:01:51,726 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/.tmp/cf/6abbb91a21d34de98154644d96830aaa as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/cf/6abbb91a21d34de98154644d96830aaa 2023-10-04 00:01:51,729 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/cf/392bc499c4cb4c31b4d27125b9bbd692, entries=3, sequenceid=6, filesize=5.4 K 2023-10-04 00:01:51,730 INFO [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 1b972a001f88a12e94ea76045c7662ce in 46ms, sequenceid=6, compaction requested=false 2023-10-04 00:01:51,730 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-04 00:01:51,731 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1b972a001f88a12e94ea76045c7662ce: 2023-10-04 00:01:51,731 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/cf/6abbb91a21d34de98154644d96830aaa, entries=47, sequenceid=6, filesize=13.1 K 2023-10-04 00:01:51,731 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,731 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:51,731 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/cf/392bc499c4cb4c31b4d27125b9bbd692] hfiles 2023-10-04 00:01:51,731 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/cf/392bc499c4cb4c31b4d27125b9bbd692 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,732 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 5045aa51eb45b466698873fbe475d4ba in 48ms, sequenceid=6, compaction requested=false 2023-10-04 00:01:51,733 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5045aa51eb45b466698873fbe475d4ba: 2023-10-04 00:01:51,733 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,733 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:01:51,733 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/cf/6abbb91a21d34de98154644d96830aaa] hfiles 2023-10-04 00:01:51,733 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/cf/6abbb91a21d34de98154644d96830aaa for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,749 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. completed. 2023-10-04 00:01:51,749 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:01:51,749 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. completed. 2023-10-04 00:01:51,749 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:51,749 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:51,749 DEBUG [rs(jenkins-hbase16.apache.org,44307,1696377627472)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:01:51,749 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,749 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:01:51,749 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:01:51,749 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,749 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 00:01:51,749 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 00:01:51,749 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:01:51,749 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:01:51,756 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 00:01:51,757 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:51,757 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 00:01:51,757 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:51,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:51,765 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,765 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 00:01:51,765 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:51,765 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 00:01:51,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:51,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:51,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:51,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase16.apache.org,44307,1696377627472': 2023-10-04 00:01:51,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 00:01:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase16.apache.org,41265,1696377627379': 2023-10-04 00:01:51,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 00:01:51,772 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-04 00:01:51,772 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:01:51,772 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:01:51,772 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,772 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:01:51,781 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,782 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,782 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,782 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,782 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,782 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,782 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,782 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:01:51,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,783 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:01:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,783 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:01:51,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:01:51,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,785 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,786 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,786 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:01:51,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,798 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,798 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,798 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,798 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,798 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:01:51,799 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:01:51,799 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,798 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,798 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,800 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:01:51,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:01:51,799 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:01:51,799 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,801 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-04 00:01:51,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,801 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:01:51,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:01:51,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,802 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:01:51,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:01:51,802 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,802 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:01:51,802 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:01:51,802 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,803 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023100435b627e38ae349e280796f6178c806c2, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004d2c37339dbca4f60a3e41df58d0e40f3] mob files 2023-10-04 00:01:51,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023100435b627e38ae349e280796f6178c806c2 2023-10-04 00:01:51,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004d2c37339dbca4f60a3e41df58d0e40f3 2023-10-04 00:01:51,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-04 00:01:51,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,834 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696377711589Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696377711813 (+224 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696377711813Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696377711813Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696377711817 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696377711826 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696377711833 (+7 ms) 2023-10-04 00:01:51,838 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 00:01:51,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 248 msec 2023-10-04 00:01:51,894 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:01:51,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 00:01:51,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:01:51,897 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377711897 2023-10-04 00:01:51,897 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43845, tgtDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377711897, rawTgtDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377711897, srcFsUri=hdfs://localhost:43845, srcDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:01:51,921 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:01:51,921 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_143802527_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377711897, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377711897/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,921 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d, snapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-04 00:01:51,926 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377711897/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:01:51,944 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:51,945 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:51,945 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:51,945 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:52,668 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-649037480573625951.jar 2023-10-04 00:01:52,669 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:52,669 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:52,722 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-6821829163211716164.jar 2023-10-04 00:01:52,722 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:52,722 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:52,723 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:52,723 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:52,723 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:52,723 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 00:01:52,724 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 00:01:52,724 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 00:01:52,724 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 00:01:52,725 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 00:01:52,725 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 00:01:52,725 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 00:01:52,725 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 00:01:52,726 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 00:01:52,726 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 00:01:52,726 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 00:01:52,727 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:52,727 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:52,727 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:52,728 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:52,728 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:01:52,728 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:52,728 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:01:53,069 WARN [Listener at jenkins-hbase16.apache.org/38813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 00:01:53,071 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-04 00:01:54,578 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:01:54,578 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:01:54,581 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0005_000001 (auth:SIMPLE) 2023-10-04 00:01:54,854 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0006_000001 (auth:SIMPLE) 2023-10-04 00:01:55,322 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 00:01:58,229 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0006_000001 (auth:SIMPLE) 2023-10-04 00:02:00,412 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 00:02:00,412 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 00:02:00,422 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:02:00,422 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 00:02:00,423 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 00:02:00,423 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:02:00,423 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-04 00:02:00,423 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-04 00:02:00,423 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377711897/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377711897/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:02:00,424 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377711897/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-04 00:02:00,424 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377711897/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-04 00:02:00,428 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 00:02:00,432 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377720432"}]},"ts":"1696377720432"} 2023-10-04 00:02:00,433 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-04 00:02:00,490 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-04 00:02:00,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b972a001f88a12e94ea76045c7662ce, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5045aa51eb45b466698873fbe475d4ba, UNASSIGN}] 2023-10-04 00:02:00,491 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5045aa51eb45b466698873fbe475d4ba, UNASSIGN 2023-10-04 00:02:00,493 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b972a001f88a12e94ea76045c7662ce, UNASSIGN 2023-10-04 00:02:00,493 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=5045aa51eb45b466698873fbe475d4ba, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:00,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1b972a001f88a12e94ea76045c7662ce, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:00,494 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696377720493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377720493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377720493"}]},"ts":"1696377720493"} 2023-10-04 00:02:00,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696377720493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377720493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377720493"}]},"ts":"1696377720493"} 2023-10-04 00:02:00,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 5045aa51eb45b466698873fbe475d4ba, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:02:00,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 1b972a001f88a12e94ea76045c7662ce, server=jenkins-hbase16.apache.org,44307,1696377627472}] 2023-10-04 00:02:00,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 00:02:00,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:02:00,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:02:00,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 1b972a001f88a12e94ea76045c7662ce, disabling compactions & flushes 2023-10-04 00:02:00,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 5045aa51eb45b466698873fbe475d4ba, disabling compactions & flushes 2023-10-04 00:02:00,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:02:00,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:02:00,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. after waiting 0 ms 2023-10-04 00:02:00,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:02:00,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:02:00,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:02:00,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. after waiting 0 ms 2023-10-04 00:02:00,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:02:00,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:02:00,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:02:00,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:00,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:00,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce. 2023-10-04 00:02:00,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba. 2023-10-04 00:02:00,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 5045aa51eb45b466698873fbe475d4ba: 2023-10-04 00:02:00,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 1b972a001f88a12e94ea76045c7662ce: 2023-10-04 00:02:00,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:02:00,666 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1b972a001f88a12e94ea76045c7662ce, regionState=CLOSED 2023-10-04 00:02:00,666 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696377720666"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377720666"}]},"ts":"1696377720666"} 2023-10-04 00:02:00,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:02:00,667 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=5045aa51eb45b466698873fbe475d4ba, regionState=CLOSED 2023-10-04 00:02:00,667 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696377720667"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377720667"}]},"ts":"1696377720667"} 2023-10-04 00:02:00,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-10-04 00:02:00,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 1b972a001f88a12e94ea76045c7662ce, server=jenkins-hbase16.apache.org,44307,1696377627472 in 171 msec 2023-10-04 00:02:00,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b972a001f88a12e94ea76045c7662ce, UNASSIGN in 178 msec 2023-10-04 00:02:00,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-10-04 00:02:00,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 5045aa51eb45b466698873fbe475d4ba, server=jenkins-hbase16.apache.org,41265,1696377627379 in 173 msec 2023-10-04 00:02:00,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-04 00:02:00,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5045aa51eb45b466698873fbe475d4ba, UNASSIGN in 179 msec 2023-10-04 00:02:00,671 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377720671"}]},"ts":"1696377720671"} 2023-10-04 00:02:00,672 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-04 00:02:00,681 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-04 00:02:00,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 253 msec 2023-10-04 00:02:00,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 00:02:00,737 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-04 00:02:00,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,744 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,745 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,747 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,750 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:02:00,750 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:02:00,752 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/recovered.edits] 2023-10-04 00:02:00,752 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/recovered.edits] 2023-10-04 00:02:00,756 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/cf/392bc499c4cb4c31b4d27125b9bbd692 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/cf/392bc499c4cb4c31b4d27125b9bbd692 2023-10-04 00:02:00,757 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/cf/6abbb91a21d34de98154644d96830aaa to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/cf/6abbb91a21d34de98154644d96830aaa 2023-10-04 00:02:00,760 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce/recovered.edits/9.seqid 2023-10-04 00:02:00,760 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba/recovered.edits/9.seqid 2023-10-04 00:02:00,760 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b972a001f88a12e94ea76045c7662ce 2023-10-04 00:02:00,760 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5045aa51eb45b466698873fbe475d4ba 2023-10-04 00:02:00,760 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-04 00:02:00,761 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-04 00:02:00,762 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-04 00:02:00,764 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,764 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,764 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,764 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 00:02:00,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 00:02:00,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 00:02:00,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 00:02:00,766 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023100435b627e38ae349e280796f6178c806c2 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023100435b627e38ae349e280796f6178c806c2 2023-10-04 00:02:00,767 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004d2c37339dbca4f60a3e41df58d0e40f3 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004d2c37339dbca4f60a3e41df58d0e40f3 2023-10-04 00:02:00,767 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-04 00:02:00,769 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,771 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-04 00:02:00,773 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,773 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:00,773 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,773 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:00,773 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,773 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:00,773 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,773 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:00,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-04 00:02:00,774 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-04 00:02:00,775 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,775 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-04 00:02:00,775 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377720775"}]},"ts":"9223372036854775807"} 2023-10-04 00:02:00,775 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377720775"}]},"ts":"9223372036854775807"} 2023-10-04 00:02:00,777 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 00:02:00,777 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1b972a001f88a12e94ea76045c7662ce, NAME => 'testtb-testEmptyExportFileSystemState,,1696377710505.1b972a001f88a12e94ea76045c7662ce.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5045aa51eb45b466698873fbe475d4ba, NAME => 'testtb-testEmptyExportFileSystemState,1,1696377710505.5045aa51eb45b466698873fbe475d4ba.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 00:02:00,777 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-04 00:02:00,777 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696377720777"}]},"ts":"9223372036854775807"} 2023-10-04 00:02:00,778 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-04 00:02:00,788 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 00:02:00,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 50 msec 2023-10-04 00:02:00,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-04 00:02:00,876 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-04 00:02:00,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-04 00:02:00,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 00:02:00,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-04 00:02:00,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-04 00:02:00,914 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 763), OpenFileDescriptor=947 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 247) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=4239 (was 4319) 2023-10-04 00:02:00,915 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-04 00:02:00,931 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=947, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=171, AvailableMemoryMB=4238 2023-10-04 00:02:00,931 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-04 00:02:00,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$4(2112): Client=jenkins//188.40.62.62 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 00:02:00,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:00,935 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 00:02:00,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-04 00:02:00,936 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 00:02:00,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 00:02:00,938 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:00,938 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:00,939 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd empty. 2023-10-04 00:02:00,939 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1 empty. 2023-10-04 00:02:00,939 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:00,939 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:00,939 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-04 00:02:00,955 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-04 00:02:00,956 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => fc9ca1232ad7ff0fda70fec016056ce1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:02:00,956 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => ec9f1270264976111dedfe111016e0dd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp 2023-10-04 00:02:00,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:02:00,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing ec9f1270264976111dedfe111016e0dd, disabling compactions & flushes 2023-10-04 00:02:00,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:00,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:00,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. after waiting 0 ms 2023-10-04 00:02:00,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:00,972 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:00,972 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for ec9f1270264976111dedfe111016e0dd: 2023-10-04 00:02:00,973 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:02:00,973 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing fc9ca1232ad7ff0fda70fec016056ce1, disabling compactions & flushes 2023-10-04 00:02:00,973 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:00,973 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:00,973 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. after waiting 0 ms 2023-10-04 00:02:00,973 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:00,974 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:00,974 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for fc9ca1232ad7ff0fda70fec016056ce1: 2023-10-04 00:02:00,976 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 00:02:00,976 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696377720976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377720976"}]},"ts":"1696377720976"} 2023-10-04 00:02:00,977 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696377720976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377720976"}]},"ts":"1696377720976"} 2023-10-04 00:02:00,979 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 00:02:00,980 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 00:02:00,980 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377720980"}]},"ts":"1696377720980"} 2023-10-04 00:02:00,981 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-04 00:02:00,998 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2023-10-04 00:02:00,999 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 00:02:00,999 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 00:02:00,999 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 00:02:00,999 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 00:02:01,000 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc9ca1232ad7ff0fda70fec016056ce1, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec9f1270264976111dedfe111016e0dd, ASSIGN}] 2023-10-04 00:02:01,002 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec9f1270264976111dedfe111016e0dd, ASSIGN 2023-10-04 00:02:01,002 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc9ca1232ad7ff0fda70fec016056ce1, ASSIGN 2023-10-04 00:02:01,003 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec9f1270264976111dedfe111016e0dd, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,41265,1696377627379; forceNewPlan=false, retain=false 2023-10-04 00:02:01,003 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc9ca1232ad7ff0fda70fec016056ce1, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,43449,1696377627431; forceNewPlan=false, retain=false 2023-10-04 00:02:01,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 00:02:01,153 INFO [jenkins-hbase16:34927] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 00:02:01,156 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=fc9ca1232ad7ff0fda70fec016056ce1, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:01,156 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ec9f1270264976111dedfe111016e0dd, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:01,156 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696377721155"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377721155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377721155"}]},"ts":"1696377721155"} 2023-10-04 00:02:01,156 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696377721155"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377721155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377721155"}]},"ts":"1696377721155"} 2023-10-04 00:02:01,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure fc9ca1232ad7ff0fda70fec016056ce1, server=jenkins-hbase16.apache.org,43449,1696377627431}] 2023-10-04 00:02:01,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure ec9f1270264976111dedfe111016e0dd, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:02:01,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 00:02:01,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:01,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:01,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fc9ca1232ad7ff0fda70fec016056ce1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 00:02:01,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec9f1270264976111dedfe111016e0dd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 00:02:01,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. service=AccessControlService 2023-10-04 00:02:01,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. service=AccessControlService 2023-10-04 00:02:01,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:02:01,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 00:02:01,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:01,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:01,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:02:01,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 00:02:01,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:01,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:01,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:01,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:01,321 INFO [StoreOpener-fc9ca1232ad7ff0fda70fec016056ce1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:01,321 INFO [StoreOpener-ec9f1270264976111dedfe111016e0dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:01,323 DEBUG [StoreOpener-ec9f1270264976111dedfe111016e0dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/cf 2023-10-04 00:02:01,323 DEBUG [StoreOpener-fc9ca1232ad7ff0fda70fec016056ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/cf 2023-10-04 00:02:01,323 DEBUG [StoreOpener-fc9ca1232ad7ff0fda70fec016056ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/cf 2023-10-04 00:02:01,323 DEBUG [StoreOpener-ec9f1270264976111dedfe111016e0dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/cf 2023-10-04 00:02:01,323 INFO [StoreOpener-fc9ca1232ad7ff0fda70fec016056ce1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc9ca1232ad7ff0fda70fec016056ce1 columnFamilyName cf 2023-10-04 00:02:01,323 INFO [StoreOpener-ec9f1270264976111dedfe111016e0dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec9f1270264976111dedfe111016e0dd columnFamilyName cf 2023-10-04 00:02:01,324 INFO [StoreOpener-ec9f1270264976111dedfe111016e0dd-1] regionserver.HStore(310): Store=ec9f1270264976111dedfe111016e0dd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:02:01,324 INFO [StoreOpener-fc9ca1232ad7ff0fda70fec016056ce1-1] regionserver.HStore(310): Store=fc9ca1232ad7ff0fda70fec016056ce1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 00:02:01,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:01,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:01,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:01,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:01,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:01,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:01,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:02:01,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 00:02:01,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened ec9f1270264976111dedfe111016e0dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67832315, jitterRate=0.01078025996685028}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:02:01,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened fc9ca1232ad7ff0fda70fec016056ce1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59747982, jitterRate=-0.10968568921089172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 00:02:01,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for ec9f1270264976111dedfe111016e0dd: 2023-10-04 00:02:01,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for fc9ca1232ad7ff0fda70fec016056ce1: 2023-10-04 00:02:01,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd., pid=109, masterSystemTime=1696377721309 2023-10-04 00:02:01,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1., pid=108, masterSystemTime=1696377721309 2023-10-04 00:02:01,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:01,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:01,332 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=ec9f1270264976111dedfe111016e0dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:01,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:01,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:01,333 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696377721332"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377721332"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377721332"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377721332"}]},"ts":"1696377721332"} 2023-10-04 00:02:01,333 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=fc9ca1232ad7ff0fda70fec016056ce1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:01,333 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696377721333"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1696377721333"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696377721333"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696377721333"}]},"ts":"1696377721333"} 2023-10-04 00:02:01,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-04 00:02:01,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure ec9f1270264976111dedfe111016e0dd, server=jenkins-hbase16.apache.org,41265,1696377627379 in 176 msec 2023-10-04 00:02:01,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-04 00:02:01,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure fc9ca1232ad7ff0fda70fec016056ce1, server=jenkins-hbase16.apache.org,43449,1696377627431 in 177 msec 2023-10-04 00:02:01,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec9f1270264976111dedfe111016e0dd, ASSIGN in 337 msec 2023-10-04 00:02:01,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-04 00:02:01,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc9ca1232ad7ff0fda70fec016056ce1, ASSIGN in 337 msec 2023-10-04 00:02:01,338 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 00:02:01,339 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377721338"}]},"ts":"1696377721338"} 2023-10-04 00:02:01,340 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-04 00:02:01,542 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 00:02:01,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 00:02:01,543 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-04 00:02:01,547 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 00:02:01,556 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:01,556 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:01,556 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:01,556 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:01,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 00:02:01,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 00:02:01,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 00:02:01,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 00:02:01,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 633 msec 2023-10-04 00:02:02,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 00:02:02,046 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-04 00:02:02,052 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,052 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:02,055 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:02:02,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 00:02:02,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377722072 (current time:1696377722072). 2023-10-04 00:02:02,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:02:02,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x359502a6 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:02:02,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a9b0ea7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:02:02,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:02:02,112 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:02:02,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x359502a6 to 127.0.0.1:51489 2023-10-04 00:02:02,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:02,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x33492b0c to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:02:02,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e548ff1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:02:02,159 DEBUG [hconnection-0x1c0852aa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:02:02,165 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:02:02,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:02:02,176 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:34426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:02:02,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33492b0c to 127.0.0.1:51489 2023-10-04 00:02:02,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:02,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 00:02:02,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:02:02,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 00:02:02,181 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:02:02,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 00:02:02,184 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 00:02:02,185 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696378322185 2023-10-04 00:02:02,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 00:02:02,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,186 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:02:02,187 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:02:02,188 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 00:02:02,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 00:02:02,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-04 00:02:02,190 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 00:02:02,191 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696378322191 2023-10-04 00:02:02,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,206 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-04 00:02:02,206 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:02:02,207 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-04 00:02:02,207 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-04 00:02:02,207 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,207 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,232 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,232 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,232 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,232 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,233 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,233 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,233 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,233 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:02:02,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 00:02:02,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 00:02:02,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,234 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 00:02:02,234 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 00:02:02,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 00:02:02,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,235 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 00:02:02,235 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 00:02:02,235 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:02:02,235 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 00:02:02,235 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,239 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 00:02:02,239 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 00:02:02,239 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 00:02:02,239 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:02:02,239 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 00:02:02,240 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:02:02,240 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 00:02:02,242 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 00:02:02,242 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 00:02:02,242 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 00:02:02,242 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 00:02:02,242 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 00:02:02,256 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,256 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:02:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:02:02,265 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,273 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,273 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,273 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,273 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:02:02,273 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:02:02,274 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:02:02,274 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,274 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:02:02,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:02:02,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:02:02,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 00:02:02,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fb9e2d2[Count = 1] remaining members to acquire global barrier 2023-10-04 00:02:02,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:02:02,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:02:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:02:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:02:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:02:02,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 00:02:02,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fb9e2d2[Count = 0] remaining members to acquire global barrier 2023-10-04 00:02:02,285 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-04 00:02:02,285 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,288 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:02:02,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 00:02:02,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:02:02,290 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:02:02,296 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,296 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,296 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,297 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,297 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 00:02:02,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,297 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:02:02,297 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:02:02,298 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,298 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:02:02,297 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 00:02:02,298 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:02,297 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 00:02:02,298 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 00:02:02,298 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. started... 2023-10-04 00:02:02,298 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:02:02,299 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:02:02,298 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:02:02,302 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec9f1270264976111dedfe111016e0dd: 2023-10-04 00:02:02,298 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:02,302 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. started... 2023-10-04 00:02:02,302 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,302 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:02:02,302 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc9ca1232ad7ff0fda70fec016056ce1: 2023-10-04 00:02:02,302 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:02:02,303 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,303 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:02:02,303 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 00:02:02,313 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 00:02:02,313 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:02:02,313 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 00:02:02,321 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. completed. 2023-10-04 00:02:02,321 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:02,321 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:02:02,321 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:02:02,321 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. completed. 2023-10-04 00:02:02,321 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,321 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:02,322 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 00:02:02,322 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:02:02,322 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:02:02,322 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:02:02,322 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,322 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 00:02:02,322 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:02:02,331 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 00:02:02,331 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:02:02,331 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,331 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 00:02:02,332 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:02:02,332 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:02:02,331 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 00:02:02,332 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 00:02:02,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:02:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:02:02,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:02:02,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:02:02,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase16.apache.org,43449,1696377627431': 2023-10-04 00:02:02,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-04 00:02:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:02:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:02:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:02:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:02:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:02:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase16.apache.org,41265,1696377627379': 2023-10-04 00:02:02,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-04 00:02:02,339 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-04 00:02:02,339 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:02:02,339 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:02:02,339 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,340 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:02:02,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:02:02,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,349 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:02:02,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,349 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:02:02,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,349 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:02:02,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,350 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:02:02,350 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,351 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,356 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,356 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,356 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,356 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,356 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,356 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,356 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:02:02,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,356 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,356 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,356 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,356 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,358 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,358 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,358 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:02:02,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,358 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,359 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,359 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,359 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,359 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 00:02:02,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,394 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-04 00:02:02,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,394 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696377722185Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696377722367 (+182 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696377722367Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696377722367Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696377722376 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696377722386 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696377722394 (+8 ms) 2023-10-04 00:02:02,396 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 00:02:02,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 210 msec 2023-10-04 00:02:02,490 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:02:02,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 00:02:02,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:02:02,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43449] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:02:02,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41265] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 00:02:02,502 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,502 DEBUG [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:02,502 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 00:02:02,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1583): Client=jenkins//188.40.62.62 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 00:02:02,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696377722512 (current time:1696377722512). 2023-10-04 00:02:02,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 00:02:02,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x3bd296fe to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:02:02,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11ed6765, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:02:02,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:02:02,526 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:02:02,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bd296fe to 127.0.0.1:51489 2023-10-04 00:02:02,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:02,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(139): Connect 0x53fe49e1 to 127.0.0.1:51489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 00:02:02,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cb45006, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 00:02:02,543 DEBUG [hconnection-0x618d6ba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:02:02,552 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:02:02,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 00:02:02,559 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:34442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 00:02:02,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53fe49e1 to 127.0.0.1:51489 2023-10-04 00:02:02,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:02,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 00:02:02,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 00:02:02,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 00:02:02,563 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot, current working dir path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 00:02:02,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 00:02:02,566 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 00:02:02,566 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696378322566 2023-10-04 00:02:02,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 00:02:02,566 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,568 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 00:02:02,568 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 00:02:02,569 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 00:02:02,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 00:02:02,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-04 00:02:02,571 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 00:02:02,572 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696378322572 2023-10-04 00:02:02,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,581 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-04 00:02:02,581 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:02:02,583 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-04 00:02:02,583 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-04 00:02:02,583 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,583 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,589 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,589 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,589 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,589 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,590 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,590 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,591 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,591 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,591 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 00:02:02,591 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 00:02:02,591 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:02:02,591 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 00:02:02,593 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 00:02:02,593 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 00:02:02,593 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:02:02,591 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 00:02:02,594 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 00:02:02,594 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 00:02:02,593 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 00:02:02,594 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 00:02:02,594 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 00:02:02,594 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 00:02:02,594 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase16.apache.org,44307,1696377627472' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 00:02:02,604 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,604 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:02:02,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:02:02,604 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,666 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,667 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,667 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:02:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:02:02,667 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,667 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:02:02,667 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:02:02,668 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,668 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:02:02,668 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 00:02:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 00:02:02,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-04 00:02:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,670 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 00:02:02,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:02:02,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,43449,1696377627431' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 00:02:02,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7891f733[Count = 1] remaining members to acquire global barrier 2023-10-04 00:02:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:02:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:02:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:02:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:02:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:02:02,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase16.apache.org,41265,1696377627379' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 00:02:02,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7891f733[Count = 0] remaining members to acquire global barrier 2023-10-04 00:02:02,679 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-04 00:02:02,679 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,690 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,690 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,690 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,690 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 00:02:02,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,691 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 00:02:02,691 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,691 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,44307,1696377627472' in zk 2023-10-04 00:02:02,691 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 00:02:02,692 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 00:02:02,692 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,692 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 00:02:02,692 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:02:02,692 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:02:02,692 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 00:02:02,693 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 00:02:02,692 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:02,693 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:02,693 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. started... 2023-10-04 00:02:02,693 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. started... 2023-10-04 00:02:02,694 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fc9ca1232ad7ff0fda70fec016056ce1 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-04 00:02:02,694 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ec9f1270264976111dedfe111016e0dd 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-04 00:02:02,698 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 00:02:02,698 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:02:02,698 DEBUG [member: 'jenkins-hbase16.apache.org,44307,1696377627472' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 00:02:02,722 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004bc92bdde5b5543f6a93626d2bdac93e1 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004bc92bdde5b5543f6a93626d2bdac93e1 2023-10-04 00:02:02,722 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310049e9fc6eeabcc4707a5efaa75192f6cd6 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310049e9fc6eeabcc4707a5efaa75192f6cd6 2023-10-04 00:02:02,733 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/.tmp/cf/c28ad7ec538a443ebf43a6d9cb136320 2023-10-04 00:02:02,733 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/.tmp/cf/5b56c406465c4445a41c66a7981a64d1 2023-10-04 00:02:02,740 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/.tmp/cf/c28ad7ec538a443ebf43a6d9cb136320 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/cf/c28ad7ec538a443ebf43a6d9cb136320 2023-10-04 00:02:02,740 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/.tmp/cf/5b56c406465c4445a41c66a7981a64d1 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/cf/5b56c406465c4445a41c66a7981a64d1 2023-10-04 00:02:02,745 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/cf/c28ad7ec538a443ebf43a6d9cb136320, entries=3, sequenceid=6, filesize=5.4 K 2023-10-04 00:02:02,745 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/cf/5b56c406465c4445a41c66a7981a64d1, entries=47, sequenceid=6, filesize=13.4 K 2023-10-04 00:02:02,746 INFO [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for fc9ca1232ad7ff0fda70fec016056ce1 in 53ms, sequenceid=6, compaction requested=false 2023-10-04 00:02:02,746 INFO [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for ec9f1270264976111dedfe111016e0dd in 52ms, sequenceid=6, compaction requested=false 2023-10-04 00:02:02,746 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-04 00:02:02,746 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-04 00:02:02,748 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc9ca1232ad7ff0fda70fec016056ce1: 2023-10-04 00:02:02,749 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,749 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:02:02,748 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec9f1270264976111dedfe111016e0dd: 2023-10-04 00:02:02,749 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/cf/c28ad7ec538a443ebf43a6d9cb136320] hfiles 2023-10-04 00:02:02,749 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/cf/c28ad7ec538a443ebf43a6d9cb136320 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,749 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,749 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 00:02:02,749 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/cf/5b56c406465c4445a41c66a7981a64d1] hfiles 2023-10-04 00:02:02,749 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/cf/5b56c406465c4445a41c66a7981a64d1 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,757 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. completed. 2023-10-04 00:02:02,757 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. completed. 2023-10-04 00:02:02,758 DEBUG [rs(jenkins-hbase16.apache.org,43449,1696377627431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:02,758 DEBUG [rs(jenkins-hbase16.apache.org,41265,1696377627379)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:02,758 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:02:02,758 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:02:02,758 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 00:02:02,758 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,758 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 00:02:02,758 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,758 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 00:02:02,758 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 00:02:02,758 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,43449,1696377627431' in zk 2023-10-04 00:02:02,758 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase16.apache.org,41265,1696377627379' in zk 2023-10-04 00:02:02,764 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 00:02:02,764 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:02:02,764 DEBUG [member: 'jenkins-hbase16.apache.org,43449,1696377627431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 00:02:02,764 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:02:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:02:02,773 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:02:02,773 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 00:02:02,773 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:02:02,773 DEBUG [member: 'jenkins-hbase16.apache.org,41265,1696377627379' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 00:02:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:02:02,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:02:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase16.apache.org,43449,1696377627431': 2023-10-04 00:02:02,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,43449,1696377627431' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-04 00:02:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:02:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:02:02,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:02:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:02:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:02:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase16.apache.org,41265,1696377627379': 2023-10-04 00:02:02,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase16.apache.org,41265,1696377627379' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-04 00:02:02,782 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-04 00:02:02,782 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 00:02:02,782 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 00:02:02,782 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,783 INFO [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 00:02:02,789 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,789 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,790 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,789 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,789 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 00:02:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 00:02:02,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,790 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,790 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 00:02:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,790 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,792 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 00:02:02,792 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 00:02:02,795 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,796 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,796 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,806 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,806 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,807 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,806 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,807 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,807 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,806 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,806 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 00:02:02,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,807 DEBUG [(jenkins-hbase16.apache.org,34927,1696377626177)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 00:02:02,807 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,809 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,809 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:02,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 00:02:02,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,807 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 00:02:02,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 00:02:02,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 00:02:02,809 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,810 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:02,810 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:02,810 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,810 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 00:02:02,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 00:02:02,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310049e9fc6eeabcc4707a5efaa75192f6cd6, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004bc92bdde5b5543f6a93626d2bdac93e1] mob files 2023-10-04 00:02:02,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310049e9fc6eeabcc4707a5efaa75192f6cd6 2023-10-04 00:02:02,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004bc92bdde5b5543f6a93626d2bdac93e1 2023-10-04 00:02:02,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,837 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-04 00:02:02,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,837 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696377722567Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696377722820 (+253 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696377722820Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696377722820Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696377722823 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696377722830 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696377722837 (+7 ms) 2023-10-04 00:02:02,839 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 00:02:02,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 272 msec 2023-10-04 00:02:02,871 DEBUG [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 00:02:02,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 00:02:02,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 00:02:02,873 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377722872 2023-10-04 00:02:02,873 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43845, tgtDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377722872, rawTgtDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377722872, srcFsUri=hdfs://localhost:43845, srcDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:02:02,895 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d 2023-10-04 00:02:02,895 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-187593244_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377722872, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377722872/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,895 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43845, inputRoot=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d, snapshotDir=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-04 00:02:02,906 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377722872/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:02,928 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:02,929 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:02,929 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:02,929 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:03,621 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-8935132942064956320.jar 2023-10-04 00:02:03,622 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:03,622 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:03,674 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/hadoop-8707245622082619665.jar 2023-10-04 00:02:03,675 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:03,675 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:03,675 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:03,676 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:03,676 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:03,676 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 00:02:03,676 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 00:02:03,677 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 00:02:03,677 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 00:02:03,677 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 00:02:03,677 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 00:02:03,678 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 00:02:03,678 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 00:02:03,678 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 00:02:03,679 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 00:02:03,679 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 00:02:03,679 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:02:03,680 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:02:03,680 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:02:03,680 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:02:03,680 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 00:02:03,681 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:02:03,681 DEBUG [Listener at jenkins-hbase16.apache.org/38813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 00:02:04,004 WARN [Listener at jenkins-hbase16.apache.org/38813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 00:02:04,005 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-04 00:02:04,007 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-04 00:02:05,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:02:05,591 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 00:02:05,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0006_000001 (auth:SIMPLE) 2023-10-04 00:02:06,238 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 00:02:06,596 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0007_000001 (auth:SIMPLE) 2023-10-04 00:02:09,883 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0007_000001 (auth:SIMPLE) 2023-10-04 00:02:12,105 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0007_000001 (auth:SIMPLE) 2023-10-04 00:02:14,296 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696377633735_0007_000001 (auth:SIMPLE) 2023-10-04 00:02:16,204 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 00:02:16,204 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 00:02:16,216 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,217 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 00:02:16,217 INFO [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 00:02:16,217 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,218 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-04 00:02:16,218 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-04 00:02:16,218 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_955129651_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377722872/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377722872/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,218 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377722872/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-04 00:02:16,219 DEBUG [Listener at jenkins-hbase16.apache.org/38813] snapshot.TestExportSnapshot(367): hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/export-test/export-1696377722872/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-04 00:02:16,225 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$11(2418): Client=jenkins//188.40.62.62 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 00:02:16,229 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377736229"}]},"ts":"1696377736229"} 2023-10-04 00:02:16,230 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-04 00:02:16,272 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-04 00:02:16,273 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc9ca1232ad7ff0fda70fec016056ce1, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec9f1270264976111dedfe111016e0dd, UNASSIGN}] 2023-10-04 00:02:16,275 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc9ca1232ad7ff0fda70fec016056ce1, UNASSIGN 2023-10-04 00:02:16,275 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec9f1270264976111dedfe111016e0dd, UNASSIGN 2023-10-04 00:02:16,276 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=ec9f1270264976111dedfe111016e0dd, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:16,276 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=fc9ca1232ad7ff0fda70fec016056ce1, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:16,276 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696377736276"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377736276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377736276"}]},"ts":"1696377736276"} 2023-10-04 00:02:16,276 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696377736276"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1696377736276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696377736276"}]},"ts":"1696377736276"} 2023-10-04 00:02:16,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure fc9ca1232ad7ff0fda70fec016056ce1, server=jenkins-hbase16.apache.org,43449,1696377627431}] 2023-10-04 00:02:16,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure ec9f1270264976111dedfe111016e0dd, server=jenkins-hbase16.apache.org,41265,1696377627379}] 2023-10-04 00:02:16,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 00:02:16,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:16,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing fc9ca1232ad7ff0fda70fec016056ce1, disabling compactions & flushes 2023-10-04 00:02:16,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:16,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:16,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. after waiting 0 ms 2023-10-04 00:02:16,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:16,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:16,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing ec9f1270264976111dedfe111016e0dd, disabling compactions & flushes 2023-10-04 00:02:16,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:16,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:16,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. after waiting 0 ms 2023-10-04 00:02:16,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:16,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:02:16,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:02:16,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:16,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:16,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd. 2023-10-04 00:02:16,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for ec9f1270264976111dedfe111016e0dd: 2023-10-04 00:02:16,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1. 2023-10-04 00:02:16,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for fc9ca1232ad7ff0fda70fec016056ce1: 2023-10-04 00:02:16,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:16,450 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=ec9f1270264976111dedfe111016e0dd, regionState=CLOSED 2023-10-04 00:02:16,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:16,450 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696377736450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377736450"}]},"ts":"1696377736450"} 2023-10-04 00:02:16,450 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=fc9ca1232ad7ff0fda70fec016056ce1, regionState=CLOSED 2023-10-04 00:02:16,450 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696377736450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696377736450"}]},"ts":"1696377736450"} 2023-10-04 00:02:16,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-04 00:02:16,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure ec9f1270264976111dedfe111016e0dd, server=jenkins-hbase16.apache.org,41265,1696377627379 in 173 msec 2023-10-04 00:02:16,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-04 00:02:16,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure fc9ca1232ad7ff0fda70fec016056ce1, server=jenkins-hbase16.apache.org,43449,1696377627431 in 173 msec 2023-10-04 00:02:16,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec9f1270264976111dedfe111016e0dd, UNASSIGN in 179 msec 2023-10-04 00:02:16,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-10-04 00:02:16,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc9ca1232ad7ff0fda70fec016056ce1, UNASSIGN in 180 msec 2023-10-04 00:02:16,458 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696377736458"}]},"ts":"1696377736458"} 2023-10-04 00:02:16,459 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-04 00:02:16,464 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-04 00:02:16,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 238 msec 2023-10-04 00:02:16,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 00:02:16,532 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-04 00:02:16,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.HMaster$5(2228): Client=jenkins//188.40.62.62 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,538 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,540 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,542 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43449] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,547 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:16,547 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:16,549 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/recovered.edits] 2023-10-04 00:02:16,549 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/cf, FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/recovered.edits] 2023-10-04 00:02:16,552 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/cf/5b56c406465c4445a41c66a7981a64d1 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/cf/5b56c406465c4445a41c66a7981a64d1 2023-10-04 00:02:16,552 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/cf/c28ad7ec538a443ebf43a6d9cb136320 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/cf/c28ad7ec538a443ebf43a6d9cb136320 2023-10-04 00:02:16,554 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd/recovered.edits/9.seqid 2023-10-04 00:02:16,554 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/recovered.edits/9.seqid to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1/recovered.edits/9.seqid 2023-10-04 00:02:16,555 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec9f1270264976111dedfe111016e0dd 2023-10-04 00:02:16,555 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc9ca1232ad7ff0fda70fec016056ce1 2023-10-04 00:02:16,555 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-04 00:02:16,555 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-04 00:02:16,555 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,555 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,555 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,555 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 00:02:16,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 00:02:16,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 00:02:16,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 00:02:16,556 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-04 00:02:16,559 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310049e9fc6eeabcc4707a5efaa75192f6cd6 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310049e9fc6eeabcc4707a5efaa75192f6cd6 2023-10-04 00:02:16,560 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004bc92bdde5b5543f6a93626d2bdac93e1 to hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004bc92bdde5b5543f6a93626d2bdac93e1 2023-10-04 00:02:16,560 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-04 00:02:16,562 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,564 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-04 00:02:16,564 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,564 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,564 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,564 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:16,564 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,564 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:16,564 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:16,564 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 00:02:16,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-04 00:02:16,565 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-04 00:02:16,566 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,566 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-04 00:02:16,566 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377736566"}]},"ts":"9223372036854775807"} 2023-10-04 00:02:16,566 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696377736566"}]},"ts":"9223372036854775807"} 2023-10-04 00:02:16,568 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 00:02:16,568 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fc9ca1232ad7ff0fda70fec016056ce1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696377720932.fc9ca1232ad7ff0fda70fec016056ce1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ec9f1270264976111dedfe111016e0dd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696377720932.ec9f1270264976111dedfe111016e0dd.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 00:02:16,568 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-04 00:02:16,568 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696377736568"}]},"ts":"9223372036854775807"} 2023-10-04 00:02:16,570 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-04 00:02:16,581 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 47 msec 2023-10-04 00:02:16,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-04 00:02:16,666 INFO [Listener at jenkins-hbase16.apache.org/38813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-04 00:02:16,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-04 00:02:16,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] master.MasterRpcServices(751): Client=jenkins//188.40.62.62 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-04 00:02:16,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34927] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 00:02:16,698 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 763), OpenFileDescriptor=910 (was 947), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 254), ProcessCount=170 (was 171), AvailableMemoryMB=4221 (was 4238) 2023-10-04 00:02:16,698 WARN [Listener at jenkins-hbase16.apache.org/38813] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-10-04 00:02:16,698 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-04 00:02:16,712 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:0 2023-10-04 00:02:16,826 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696377633735_0007_01_000001 is : 143 2023-10-04 00:02:22,034 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 00:02:30,844 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:0 2023-10-04 00:02:44,976 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 00:02:44,976 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:0 2023-10-04 00:02:45,088 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-04 00:02:45,097 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-04 00:02:45,098 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 00:02:45,110 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase16.apache.org:0 2023-10-04 00:02:45,214 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 00:02:45,214 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-04 00:02:45,214 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-04 00:02:45,215 INFO [Listener at jenkins-hbase16.apache.org/38813] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-04 00:02:45,215 DEBUG [Listener at jenkins-hbase16.apache.org/38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6194af79 to 127.0.0.1:51489 2023-10-04 00:02:45,215 DEBUG [Listener at jenkins-hbase16.apache.org/38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:45,215 DEBUG [Listener at jenkins-hbase16.apache.org/38813] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-04 00:02:45,216 DEBUG [Listener at jenkins-hbase16.apache.org/38813] util.JVMClusterUtil(257): Found active master hash=1050215090, stopped=false 2023-10-04 00:02:45,217 DEBUG [Listener at jenkins-hbase16.apache.org/38813] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:45,217 DEBUG [Listener at jenkins-hbase16.apache.org/38813] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-04 00:02:45,217 INFO [Listener at jenkins-hbase16.apache.org/38813] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase16.apache.org,34927,1696377626177 2023-10-04 00:02:45,246 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 00:02:45,246 INFO [Listener at jenkins-hbase16.apache.org/38813] procedure2.ProcedureExecutor(628): Stopping 2023-10-04 00:02:45,246 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 00:02:45,246 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 00:02:45,246 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 00:02:45,246 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:02:45,246 DEBUG [Listener at jenkins-hbase16.apache.org/38813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4711e772 to 127.0.0.1:51489 2023-10-04 00:02:45,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 00:02:45,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 00:02:45,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 00:02:45,247 DEBUG [Listener at jenkins-hbase16.apache.org/38813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:45,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 00:02:45,247 INFO [Listener at jenkins-hbase16.apache.org/38813] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase16.apache.org,41265,1696377627379' ***** 2023-10-04 00:02:45,247 DEBUG [Listener at jenkins-hbase16.apache.org/38813] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:45,247 INFO [Listener at jenkins-hbase16.apache.org/38813] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 00:02:45,248 INFO [Listener at jenkins-hbase16.apache.org/38813] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase16.apache.org,43449,1696377627431' ***** 2023-10-04 00:02:45,248 DEBUG [Listener at jenkins-hbase16.apache.org/38813] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:45,248 INFO [RS:0;jenkins-hbase16:41265] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 00:02:45,248 INFO [Listener at jenkins-hbase16.apache.org/38813] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 00:02:45,248 INFO [Listener at jenkins-hbase16.apache.org/38813] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase16.apache.org,44307,1696377627472' ***** 2023-10-04 00:02:45,248 INFO [RS:0;jenkins-hbase16:41265] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 00:02:45,248 DEBUG [Listener at jenkins-hbase16.apache.org/38813] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:45,248 INFO [RS:0;jenkins-hbase16:41265] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 00:02:45,248 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 00:02:45,248 INFO [RS:1;jenkins-hbase16:43449] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 00:02:45,248 INFO [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1144): stopping server jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:45,248 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 00:02:45,248 DEBUG [RS:0;jenkins-hbase16:41265] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c11f2e7 to 127.0.0.1:51489 2023-10-04 00:02:45,248 INFO [Listener at jenkins-hbase16.apache.org/38813] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 00:02:45,248 DEBUG [RS:0;jenkins-hbase16:41265] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:45,249 INFO [RS:2;jenkins-hbase16:44307] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 00:02:45,251 INFO [RS:0;jenkins-hbase16:41265] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 00:02:45,251 INFO [RS:0;jenkins-hbase16:41265] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 00:02:45,251 INFO [RS:0;jenkins-hbase16:41265] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 00:02:45,248 INFO [RS:1;jenkins-hbase16:43449] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 00:02:45,251 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 00:02:45,251 INFO [RS:2;jenkins-hbase16:44307] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 00:02:45,251 INFO [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-04 00:02:45,251 INFO [RS:1;jenkins-hbase16:43449] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 00:02:45,252 INFO [RS:2;jenkins-hbase16:44307] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 00:02:45,252 INFO [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(3305): Received CLOSE for ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:02:45,252 INFO [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(3305): Received CLOSE for ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:02:45,252 INFO [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1144): stopping server jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:45,252 INFO [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1144): stopping server jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:45,252 DEBUG [RS:1;jenkins-hbase16:43449] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03c3cac5 to 127.0.0.1:51489 2023-10-04 00:02:45,253 INFO [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-04 00:02:45,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing ec735c15bdc23c776aec5f35d2d224b5, disabling compactions & flushes 2023-10-04 00:02:45,254 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-04 00:02:45,254 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-04 00:02:45,254 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-04 00:02:45,254 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-04 00:02:45,254 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-04 00:02:45,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing ce48a7339c79d185ddb5ec0bd7189f00, disabling compactions & flushes 2023-10-04 00:02:45,254 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-10-04 00:02:45,252 DEBUG [RS:2;jenkins-hbase16:44307] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38f9d3c7 to 127.0.0.1:51489 2023-10-04 00:02:45,254 DEBUG [RS:2;jenkins-hbase16:44307] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:45,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:02:45,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:02:45,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:02:45,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. after waiting 0 ms 2023-10-04 00:02:45,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:02:45,253 DEBUG [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-04 00:02:45,253 DEBUG [RS:1;jenkins-hbase16:43449] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:45,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing ec735c15bdc23c776aec5f35d2d224b5 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-04 00:02:45,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:02:45,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. after waiting 0 ms 2023-10-04 00:02:45,255 INFO [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-04 00:02:45,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:02:45,256 INFO [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-04 00:02:45,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing ce48a7339c79d185ddb5ec0bd7189f00 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-04 00:02:45,257 DEBUG [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1478): Online Regions={ce48a7339c79d185ddb5ec0bd7189f00=hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00.} 2023-10-04 00:02:45,257 DEBUG [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-04 00:02:45,257 DEBUG [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1478): Online Regions={ec735c15bdc23c776aec5f35d2d224b5=hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5.} 2023-10-04 00:02:45,257 DEBUG [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1504): Waiting on ce48a7339c79d185ddb5ec0bd7189f00 2023-10-04 00:02:45,257 DEBUG [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1504): Waiting on ec735c15bdc23c776aec5f35d2d224b5 2023-10-04 00:02:45,274 INFO [regionserver/jenkins-hbase16:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 00:02:45,274 INFO [regionserver/jenkins-hbase16:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 00:02:45,274 INFO [regionserver/jenkins-hbase16:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 00:02:45,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00/.tmp/l/7f31a70c856d47d2921f817c6a6846c1 2023-10-04 00:02:45,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5/.tmp/info/9f90fb6b2d074ad385875ed7a0e1e80f 2023-10-04 00:02:45,293 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/.tmp/info/256a14e9cace40e086c17ac3553db7d6 2023-10-04 00:02:45,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5/.tmp/info/9f90fb6b2d074ad385875ed7a0e1e80f as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5/info/9f90fb6b2d074ad385875ed7a0e1e80f 2023-10-04 00:02:45,297 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 256a14e9cace40e086c17ac3553db7d6 2023-10-04 00:02:45,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f31a70c856d47d2921f817c6a6846c1 2023-10-04 00:02:45,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00/.tmp/l/7f31a70c856d47d2921f817c6a6846c1 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00/l/7f31a70c856d47d2921f817c6a6846c1 2023-10-04 00:02:45,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5/info/9f90fb6b2d074ad385875ed7a0e1e80f, entries=2, sequenceid=6, filesize=4.8 K 2023-10-04 00:02:45,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ec735c15bdc23c776aec5f35d2d224b5 in 46ms, sequenceid=6, compaction requested=false 2023-10-04 00:02:45,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f31a70c856d47d2921f817c6a6846c1 2023-10-04 00:02:45,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00/l/7f31a70c856d47d2921f817c6a6846c1, entries=7, sequenceid=18, filesize=5.2 K 2023-10-04 00:02:45,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ce48a7339c79d185ddb5ec0bd7189f00 in 45ms, sequenceid=18, compaction requested=false 2023-10-04 00:02:45,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/acl/ce48a7339c79d185ddb5ec0bd7189f00/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-04 00:02:45,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:45,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:02:45,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for ce48a7339c79d185ddb5ec0bd7189f00: 2023-10-04 00:02:45,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696377630502.ce48a7339c79d185ddb5ec0bd7189f00. 2023-10-04 00:02:45,322 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/.tmp/rep_barrier/f93961e4afbf432cb5cddcc82c48f563 2023-10-04 00:02:45,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/namespace/ec735c15bdc23c776aec5f35d2d224b5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 00:02:45,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:45,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:02:45,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for ec735c15bdc23c776aec5f35d2d224b5: 2023-10-04 00:02:45,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696377629669.ec735c15bdc23c776aec5f35d2d224b5. 2023-10-04 00:02:45,328 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f93961e4afbf432cb5cddcc82c48f563 2023-10-04 00:02:45,340 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/.tmp/table/c0c3124120a848d8825e8df7b0b1a7bc 2023-10-04 00:02:45,344 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0c3124120a848d8825e8df7b0b1a7bc 2023-10-04 00:02:45,344 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/.tmp/info/256a14e9cace40e086c17ac3553db7d6 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/info/256a14e9cace40e086c17ac3553db7d6 2023-10-04 00:02:45,349 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 256a14e9cace40e086c17ac3553db7d6 2023-10-04 00:02:45,349 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/info/256a14e9cace40e086c17ac3553db7d6, entries=48, sequenceid=131, filesize=10.3 K 2023-10-04 00:02:45,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/.tmp/rep_barrier/f93961e4afbf432cb5cddcc82c48f563 as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/rep_barrier/f93961e4afbf432cb5cddcc82c48f563 2023-10-04 00:02:45,354 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f93961e4afbf432cb5cddcc82c48f563 2023-10-04 00:02:45,355 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/rep_barrier/f93961e4afbf432cb5cddcc82c48f563, entries=13, sequenceid=131, filesize=6.4 K 2023-10-04 00:02:45,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/.tmp/table/c0c3124120a848d8825e8df7b0b1a7bc as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/table/c0c3124120a848d8825e8df7b0b1a7bc 2023-10-04 00:02:45,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0c3124120a848d8825e8df7b0b1a7bc 2023-10-04 00:02:45,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/table/c0c3124120a848d8825e8df7b0b1a7bc, entries=24, sequenceid=131, filesize=6.9 K 2023-10-04 00:02:45,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 107ms, sequenceid=131, compaction requested=false 2023-10-04 00:02:45,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-04 00:02:45,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:45,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-04 00:02:45,374 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-04 00:02:45,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-04 00:02:45,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-04 00:02:45,457 INFO [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1170): stopping server jenkins-hbase16.apache.org,41265,1696377627379; all regions closed. 2023-10-04 00:02:45,457 INFO [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1170): stopping server jenkins-hbase16.apache.org,43449,1696377627431; all regions closed. 2023-10-04 00:02:45,457 INFO [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1170): stopping server jenkins-hbase16.apache.org,44307,1696377627472; all regions closed. 2023-10-04 00:02:45,471 DEBUG [RS:0;jenkins-hbase16:41265] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/oldWALs 2023-10-04 00:02:45,471 DEBUG [RS:2;jenkins-hbase16:44307] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/oldWALs 2023-10-04 00:02:45,471 DEBUG [RS:1;jenkins-hbase16:43449] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/oldWALs 2023-10-04 00:02:45,471 INFO [RS:0;jenkins-hbase16:41265] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C41265%2C1696377627379.meta:.meta(num 1696377629354) 2023-10-04 00:02:45,471 INFO [RS:1;jenkins-hbase16:43449] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C43449%2C1696377627431:(num 1696377629236) 2023-10-04 00:02:45,471 INFO [RS:2;jenkins-hbase16:44307] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C44307%2C1696377627472:(num 1696377629236) 2023-10-04 00:02:45,471 DEBUG [RS:1;jenkins-hbase16:43449] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:45,471 DEBUG [RS:2;jenkins-hbase16:44307] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:45,471 INFO [RS:1;jenkins-hbase16:43449] regionserver.LeaseManager(133): Closed leases 2023-10-04 00:02:45,471 INFO [RS:2;jenkins-hbase16:44307] regionserver.LeaseManager(133): Closed leases 2023-10-04 00:02:45,472 INFO [RS:2;jenkins-hbase16:44307] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase16:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-04 00:02:45,472 INFO [RS:2;jenkins-hbase16:44307] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 00:02:45,472 INFO [regionserver/jenkins-hbase16:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 00:02:45,472 INFO [RS:2;jenkins-hbase16:44307] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 00:02:45,472 INFO [RS:2;jenkins-hbase16:44307] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 00:02:45,473 INFO [RS:2;jenkins-hbase16:44307] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:44307 2023-10-04 00:02:45,473 INFO [RS:1;jenkins-hbase16:43449] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase16:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-04 00:02:45,473 INFO [RS:1;jenkins-hbase16:43449] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 00:02:45,473 INFO [regionserver/jenkins-hbase16:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 00:02:45,474 INFO [RS:1;jenkins-hbase16:43449] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 00:02:45,474 INFO [RS:1;jenkins-hbase16:43449] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 00:02:45,474 INFO [RS:1;jenkins-hbase16:43449] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:43449 2023-10-04 00:02:45,479 DEBUG [RS:0;jenkins-hbase16:41265] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/oldWALs 2023-10-04 00:02:45,479 INFO [RS:0;jenkins-hbase16:41265] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C41265%2C1696377627379:(num 1696377629236) 2023-10-04 00:02:45,479 DEBUG [RS:0;jenkins-hbase16:41265] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:45,479 INFO [RS:0;jenkins-hbase16:41265] regionserver.LeaseManager(133): Closed leases 2023-10-04 00:02:45,480 INFO [RS:0;jenkins-hbase16:41265] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase16:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-04 00:02:45,480 INFO [regionserver/jenkins-hbase16:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 00:02:45,481 INFO [RS:0;jenkins-hbase16:41265] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:41265 2023-10-04 00:02:45,487 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:45,487 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 00:02:45,487 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:45,487 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,43449,1696377627431 2023-10-04 00:02:45,488 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 00:02:45,487 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 00:02:45,488 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 00:02:45,496 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:45,496 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:45,496 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:45,496 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:45,496 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,44307,1696377627472 2023-10-04 00:02:45,496 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,41265,1696377627379 2023-10-04 00:02:45,504 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase16.apache.org,43449,1696377627431] 2023-10-04 00:02:45,505 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase16.apache.org,43449,1696377627431; numProcessing=1 2023-10-04 00:02:45,521 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase16.apache.org,43449,1696377627431 already deleted, retry=false 2023-10-04 00:02:45,521 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase16.apache.org,43449,1696377627431 expired; onlineServers=2 2023-10-04 00:02:45,521 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase16.apache.org,41265,1696377627379] 2023-10-04 00:02:45,521 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase16.apache.org,41265,1696377627379; numProcessing=2 2023-10-04 00:02:45,529 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase16.apache.org,41265,1696377627379 already deleted, retry=false 2023-10-04 00:02:45,529 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase16.apache.org,41265,1696377627379 expired; onlineServers=1 2023-10-04 00:02:45,529 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase16.apache.org,44307,1696377627472] 2023-10-04 00:02:45,530 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase16.apache.org,44307,1696377627472; numProcessing=3 2023-10-04 00:02:45,538 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase16.apache.org,44307,1696377627472 already deleted, retry=false 2023-10-04 00:02:45,538 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase16.apache.org,44307,1696377627472 expired; onlineServers=0 2023-10-04 00:02:45,538 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase16.apache.org,34927,1696377626177' ***** 2023-10-04 00:02:45,538 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-04 00:02:45,538 DEBUG [M:0;jenkins-hbase16:34927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fa40889, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2023-10-04 00:02:45,538 INFO [M:0;jenkins-hbase16:34927] regionserver.HRegionServer(1144): stopping server jenkins-hbase16.apache.org,34927,1696377626177 2023-10-04 00:02:45,539 INFO [M:0;jenkins-hbase16:34927] regionserver.HRegionServer(1170): stopping server jenkins-hbase16.apache.org,34927,1696377626177; all regions closed. 2023-10-04 00:02:45,539 DEBUG [M:0;jenkins-hbase16:34927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 00:02:45,539 DEBUG [M:0;jenkins-hbase16:34927] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-04 00:02:45,539 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-04 00:02:45,539 DEBUG [M:0;jenkins-hbase16:34927] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-04 00:02:45,539 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1696377628790] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1696377628790,5,FailOnTimeoutGroup] 2023-10-04 00:02:45,540 INFO [M:0;jenkins-hbase16:34927] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-04 00:02:45,540 INFO [M:0;jenkins-hbase16:34927] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-04 00:02:45,539 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1696377628789] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1696377628789,5,FailOnTimeoutGroup] 2023-10-04 00:02:45,540 INFO [M:0;jenkins-hbase16:34927] hbase.ChoreService(369): Chore service for: master/jenkins-hbase16:0 had [] on shutdown 2023-10-04 00:02:45,540 DEBUG [M:0;jenkins-hbase16:34927] master.HMaster(1512): Stopping service threads 2023-10-04 00:02:45,540 INFO [M:0;jenkins-hbase16:34927] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-04 00:02:45,541 ERROR [M:0;jenkins-hbase16:34927] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-16,5,PEWorkerGroup] 2023-10-04 00:02:45,542 INFO [M:0;jenkins-hbase16:34927] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-04 00:02:45,542 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-04 00:02:45,546 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-04 00:02:45,546 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 00:02:45,546 DEBUG [M:0;jenkins-hbase16:34927] zookeeper.ZKUtil(398): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-04 00:02:45,547 WARN [M:0;jenkins-hbase16:34927] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-04 00:02:45,547 INFO [M:0;jenkins-hbase16:34927] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-04 00:02:45,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 00:02:45,547 INFO [M:0;jenkins-hbase16:34927] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-04 00:02:45,549 DEBUG [M:0;jenkins-hbase16:34927] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-04 00:02:45,549 INFO [M:0;jenkins-hbase16:34927] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 00:02:45,549 DEBUG [M:0;jenkins-hbase16:34927] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 00:02:45,550 DEBUG [M:0;jenkins-hbase16:34927] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-04 00:02:45,550 DEBUG [M:0;jenkins-hbase16:34927] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 00:02:45,550 INFO [M:0;jenkins-hbase16:34927] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.28 KB heapSize=452.51 KB 2023-10-04 00:02:45,563 INFO [M:0;jenkins-hbase16:34927] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.28 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/23d3ad3e66784f4cb88c4edb2786a1fe 2023-10-04 00:02:45,567 INFO [M:0;jenkins-hbase16:34927] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23d3ad3e66784f4cb88c4edb2786a1fe 2023-10-04 00:02:45,568 DEBUG [M:0;jenkins-hbase16:34927] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/23d3ad3e66784f4cb88c4edb2786a1fe as hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/23d3ad3e66784f4cb88c4edb2786a1fe 2023-10-04 00:02:45,571 INFO [M:0;jenkins-hbase16:34927] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23d3ad3e66784f4cb88c4edb2786a1fe 2023-10-04 00:02:45,571 INFO [M:0;jenkins-hbase16:34927] regionserver.HStore(1080): Added hdfs://localhost:43845/user/jenkins/test-data/f773fe6c-d19e-bc6e-7bd9-731d4b54863d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/23d3ad3e66784f4cb88c4edb2786a1fe, entries=119, sequenceid=899, filesize=28.7 K 2023-10-04 00:02:45,572 INFO [M:0;jenkins-hbase16:34927] regionserver.HRegion(2948): Finished flush of dataSize ~376.28 KB/385311, heapSize ~452.49 KB/463352, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-10-04 00:02:45,573 INFO [M:0;jenkins-hbase16:34927] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 00:02:45,573 DEBUG [M:0;jenkins-hbase16:34927] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 00:02:45,577 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 00:02:45,577 INFO [M:0;jenkins-hbase16:34927] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-04 00:02:45,578 INFO [M:0;jenkins-hbase16:34927] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:34927 2023-10-04 00:02:45,588 DEBUG [M:0;jenkins-hbase16:34927] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase16.apache.org,34927,1696377626177 already deleted, retry=false 2023-10-04 00:02:45,605 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 00:02:45,605 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:43449-0x1010ebb4dca0002, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 00:02:45,605 INFO [RS:1;jenkins-hbase16:43449] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase16.apache.org,43449,1696377627431; zookeeper connection closed. 2023-10-04 00:02:45,605 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f70f39c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f70f39c 2023-10-04 00:02:45,705 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 00:02:45,705 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): master:34927-0x1010ebb4dca0000, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 00:02:45,705 INFO [M:0;jenkins-hbase16:34927] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase16.apache.org,34927,1696377626177; zookeeper connection closed. 2023-10-04 00:02:45,805 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 00:02:45,805 INFO [RS:2;jenkins-hbase16:44307] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase16.apache.org,44307,1696377627472; zookeeper connection closed. 2023-10-04 00:02:45,805 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:44307-0x1010ebb4dca0003, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 00:02:45,806 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a7f1c63] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a7f1c63 2023-10-04 00:02:45,906 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 00:02:45,906 INFO [RS:0;jenkins-hbase16:41265] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase16.apache.org,41265,1696377627379; zookeeper connection closed. 2023-10-04 00:02:45,906 DEBUG [Listener at localhost/37259-EventThread] zookeeper.ZKWatcher(600): regionserver:41265-0x1010ebb4dca0001, quorum=127.0.0.1:51489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 00:02:45,907 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f664598] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f664598 2023-10-04 00:02:45,907 INFO [Listener at jenkins-hbase16.apache.org/38813] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-04 00:02:45,908 WARN [Listener at jenkins-hbase16.apache.org/38813] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 00:02:45,939 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 00:02:46,045 WARN [BP-1230124010-188.40.62.62-1696377621839 heartbeating to localhost/127.0.0.1:43845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 00:02:46,046 WARN [BP-1230124010-188.40.62.62-1696377621839 heartbeating to localhost/127.0.0.1:43845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1230124010-188.40.62.62-1696377621839 (Datanode Uuid 79551e84-44dd-466c-aa1c-dd0404cbf780) service to localhost/127.0.0.1:43845 2023-10-04 00:02:46,051 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data5/current/BP-1230124010-188.40.62.62-1696377621839] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 00:02:46,051 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data6/current/BP-1230124010-188.40.62.62-1696377621839] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 00:02:46,053 WARN [Listener at jenkins-hbase16.apache.org/38813] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 00:02:46,055 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 00:02:46,158 WARN [BP-1230124010-188.40.62.62-1696377621839 heartbeating to localhost/127.0.0.1:43845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 00:02:46,158 WARN [BP-1230124010-188.40.62.62-1696377621839 heartbeating to localhost/127.0.0.1:43845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1230124010-188.40.62.62-1696377621839 (Datanode Uuid e2a82143-02a3-4523-8a8a-f010d22b3920) service to localhost/127.0.0.1:43845 2023-10-04 00:02:46,160 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data3/current/BP-1230124010-188.40.62.62-1696377621839] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 00:02:46,161 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data4/current/BP-1230124010-188.40.62.62-1696377621839] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 00:02:46,162 WARN [Listener at jenkins-hbase16.apache.org/38813] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 00:02:46,165 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 00:02:46,232 WARN [BP-1230124010-188.40.62.62-1696377621839 heartbeating to localhost/127.0.0.1:43845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1230124010-188.40.62.62-1696377621839 (Datanode Uuid 9999fcff-7b53-4b4f-95e1-111edab39647) service to localhost/127.0.0.1:43845 2023-10-04 00:02:46,233 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data1/current/BP-1230124010-188.40.62.62-1696377621839] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 00:02:46,234 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/562af7d5-c444-01e7-07ad-d849ce0be725/cluster_77b0c654-c5a6-98e7-137b-8a35277716fe/dfs/data/data2/current/BP-1230124010-188.40.62.62-1696377621839] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 00:02:46,291 INFO [Listener at jenkins-hbase16.apache.org/38813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 00:02:46,386 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:46,386 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-04 00:02:46,386 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:46,387 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-04 00:02:46,387 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 00:02:46,419 INFO [Listener at jenkins-hbase16.apache.org/38813] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-04 00:02:46,508 INFO [Listener at jenkins-hbase16.apache.org/38813] hbase.HBaseTestingUtility(1293): Minicluster is down