2023-09-20 23:01:12,388 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-20 23:01:12,592 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492 2023-09-20 23:01:12,593 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-20 23:01:12,593 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-20 23:01:12,632 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-20 23:01:12,898 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-20 23:01:12,898 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d, deleteOnExit=true 2023-09-20 23:01:12,899 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-20 23:01:12,899 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/test.cache.data in system properties and HBase conf 2023-09-20 23:01:12,900 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop.tmp.dir in system properties and HBase conf 2023-09-20 23:01:12,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop.log.dir in system properties and HBase conf 2023-09-20 23:01:12,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-20 23:01:12,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-20 23:01:12,901 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-20 23:01:13,219 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-20 23:01:13,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-20 23:01:13,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-20 23:01:13,224 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-20 23:01:13,225 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-20 23:01:13,225 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-20 23:01:13,225 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-20 23:01:13,225 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-20 23:01:13,226 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-20 23:01:13,226 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-20 23:01:13,226 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/nfs.dump.dir in system properties and HBase conf 2023-09-20 23:01:13,226 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/java.io.tmpdir in system properties and HBase conf 2023-09-20 23:01:13,227 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-20 23:01:13,227 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-20 23:01:13,227 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-20 23:01:13,730 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-20 23:01:13,734 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-20 23:01:14,071 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-20 23:01:14,271 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-20 23:01:14,284 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 23:01:14,325 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 23:01:14,362 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/java.io.tmpdir/Jetty_localhost_34033_hdfs____tjtxrt/webapp 2023-09-20 23:01:14,507 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34033 2023-09-20 23:01:14,523 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-20 23:01:14,523 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-20 23:01:15,021 WARN [Listener at localhost/37461] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-20 23:01:15,093 WARN [Listener at localhost/37461] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-20 23:01:15,115 WARN [Listener at localhost/37461] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 23:01:15,179 INFO [Listener at localhost/37461] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 23:01:15,187 INFO [Listener at localhost/37461] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/java.io.tmpdir/Jetty_localhost_33551_datanode____.rlkgvc/webapp 2023-09-20 23:01:15,286 INFO [Listener at localhost/37461] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33551 2023-09-20 23:01:15,711 WARN [Listener at localhost/43257] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-20 23:01:15,725 WARN [Listener at localhost/43257] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-20 23:01:15,729 WARN [Listener at localhost/43257] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 23:01:15,731 INFO [Listener at localhost/43257] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 23:01:15,743 INFO [Listener at localhost/43257] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/java.io.tmpdir/Jetty_localhost_41165_datanode____q8c2uy/webapp 2023-09-20 23:01:15,848 INFO [Listener at localhost/43257] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41165 2023-09-20 23:01:15,859 WARN [Listener at localhost/35139] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-20 23:01:15,876 WARN [Listener at localhost/35139] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-20 23:01:15,880 WARN [Listener at localhost/35139] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 23:01:15,882 INFO [Listener at localhost/35139] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 23:01:15,893 INFO [Listener at localhost/35139] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/java.io.tmpdir/Jetty_localhost_40605_datanode____.3l9z2y/webapp 2023-09-20 23:01:16,017 INFO [Listener at localhost/35139] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40605 2023-09-20 23:01:16,030 WARN [Listener at localhost/33567] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-20 23:01:16,327 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d017286938ff982: Processing first storage report for DS-0d294203-1ead-4e43-973d-c79afa9617dc from datanode 3c0b6b46-462d-46ed-b715-ae152a4a590a 2023-09-20 23:01:16,329 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d017286938ff982: from storage DS-0d294203-1ead-4e43-973d-c79afa9617dc node DatanodeRegistration(127.0.0.1:39553, datanodeUuid=3c0b6b46-462d-46ed-b715-ae152a4a590a, infoPort=34821, infoSecurePort=0, ipcPort=43257, storageInfo=lv=-57;cid=testClusterID;nsid=1863722381;c=1695250873816), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-20 23:01:16,329 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8832f7af910734c7: Processing first storage report for DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4 from datanode 1d459a81-2e3f-429b-8103-a00b3d7a2239 2023-09-20 23:01:16,329 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8832f7af910734c7: from storage DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4 node DatanodeRegistration(127.0.0.1:41377, datanodeUuid=1d459a81-2e3f-429b-8103-a00b3d7a2239, infoPort=44109, infoSecurePort=0, ipcPort=35139, storageInfo=lv=-57;cid=testClusterID;nsid=1863722381;c=1695250873816), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-20 23:01:16,329 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf9c07d797348b83f: Processing first storage report for DS-531e46ef-f8d5-4b9f-b0e6-824070080bad from datanode a768f595-0875-4b6c-bc0c-4f1b8a1014cc 2023-09-20 23:01:16,330 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf9c07d797348b83f: from storage DS-531e46ef-f8d5-4b9f-b0e6-824070080bad node DatanodeRegistration(127.0.0.1:46001, datanodeUuid=a768f595-0875-4b6c-bc0c-4f1b8a1014cc, infoPort=44975, infoSecurePort=0, ipcPort=33567, storageInfo=lv=-57;cid=testClusterID;nsid=1863722381;c=1695250873816), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-20 23:01:16,330 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d017286938ff982: Processing first storage report for DS-780563ba-0426-43eb-ab44-e33bdebacbf4 from datanode 3c0b6b46-462d-46ed-b715-ae152a4a590a 2023-09-20 23:01:16,330 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d017286938ff982: from storage DS-780563ba-0426-43eb-ab44-e33bdebacbf4 node DatanodeRegistration(127.0.0.1:39553, datanodeUuid=3c0b6b46-462d-46ed-b715-ae152a4a590a, infoPort=34821, infoSecurePort=0, ipcPort=43257, storageInfo=lv=-57;cid=testClusterID;nsid=1863722381;c=1695250873816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-20 23:01:16,330 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8832f7af910734c7: Processing first storage report for DS-7599b5e7-f382-46ef-829b-a5ea761fb784 from datanode 1d459a81-2e3f-429b-8103-a00b3d7a2239 2023-09-20 23:01:16,330 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8832f7af910734c7: from storage DS-7599b5e7-f382-46ef-829b-a5ea761fb784 node DatanodeRegistration(127.0.0.1:41377, datanodeUuid=1d459a81-2e3f-429b-8103-a00b3d7a2239, infoPort=44109, infoSecurePort=0, ipcPort=35139, storageInfo=lv=-57;cid=testClusterID;nsid=1863722381;c=1695250873816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-20 23:01:16,330 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf9c07d797348b83f: Processing first storage report for DS-0dfcfeeb-7649-41b4-a234-21a46c23bd1f from datanode a768f595-0875-4b6c-bc0c-4f1b8a1014cc 2023-09-20 23:01:16,330 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf9c07d797348b83f: from storage DS-0dfcfeeb-7649-41b4-a234-21a46c23bd1f node DatanodeRegistration(127.0.0.1:46001, datanodeUuid=a768f595-0875-4b6c-bc0c-4f1b8a1014cc, infoPort=44975, infoSecurePort=0, ipcPort=33567, storageInfo=lv=-57;cid=testClusterID;nsid=1863722381;c=1695250873816), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-20 23:01:16,542 DEBUG [Listener at localhost/33567] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492 2023-09-20 23:01:16,639 INFO [Listener at localhost/33567] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/zookeeper_0, clientPort=53756, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-20 23:01:16,663 INFO [Listener at localhost/33567] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53756 2023-09-20 23:01:16,674 INFO [Listener at localhost/33567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:16,677 INFO [Listener at localhost/33567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:17,372 INFO [Listener at localhost/33567] util.FSUtils(471): Created version file at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 with version=8 2023-09-20 23:01:17,372 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/hbase-staging 2023-09-20 23:01:17,781 INFO [Listener at localhost/33567] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-20 23:01:18,270 INFO [Listener at localhost/33567] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-20 23:01:18,303 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,303 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,304 INFO [Listener at localhost/33567] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-20 23:01:18,304 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,304 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-20 23:01:18,454 INFO [Listener at localhost/33567] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-20 23:01:18,528 DEBUG [Listener at localhost/33567] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-20 23:01:18,624 INFO [Listener at localhost/33567] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45915 2023-09-20 23:01:18,637 INFO [Listener at localhost/33567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:18,639 INFO [Listener at localhost/33567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:18,662 INFO [Listener at localhost/33567] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45915 connecting to ZooKeeper ensemble=127.0.0.1:53756 2023-09-20 23:01:18,726 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:459150x0, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-20 23:01:18,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45915-0x100cb92c0690000 connected 2023-09-20 23:01:18,768 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-20 23:01:18,769 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 23:01:18,788 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-20 23:01:18,800 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45915 2023-09-20 23:01:18,801 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45915 2023-09-20 23:01:18,801 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45915 2023-09-20 23:01:18,802 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45915 2023-09-20 23:01:18,802 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45915 2023-09-20 23:01:18,808 INFO [Listener at localhost/33567] master.HMaster(444): hbase.rootdir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611, hbase.cluster.distributed=false 2023-09-20 23:01:18,874 INFO [Listener at localhost/33567] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-20 23:01:18,874 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,874 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,874 INFO [Listener at localhost/33567] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-20 23:01:18,874 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,874 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-20 23:01:18,879 INFO [Listener at localhost/33567] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-20 23:01:18,882 INFO [Listener at localhost/33567] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35755 2023-09-20 23:01:18,885 INFO [Listener at localhost/33567] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-20 23:01:18,891 INFO [Listener at localhost/33567] mob.MobFileCache(124): MobFileCache disabled 2023-09-20 23:01:18,892 INFO [Listener at localhost/33567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:18,894 INFO [Listener at localhost/33567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:18,896 INFO [Listener at localhost/33567] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35755 connecting to ZooKeeper ensemble=127.0.0.1:53756 2023-09-20 23:01:18,900 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:357550x0, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-20 23:01:18,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35755-0x100cb92c0690001 connected 2023-09-20 23:01:18,902 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-20 23:01:18,903 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 23:01:18,904 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-20 23:01:18,905 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35755 2023-09-20 23:01:18,905 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35755 2023-09-20 23:01:18,909 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35755 2023-09-20 23:01:18,909 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35755 2023-09-20 23:01:18,910 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35755 2023-09-20 23:01:18,923 INFO [Listener at localhost/33567] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-20 23:01:18,923 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,923 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,924 INFO [Listener at localhost/33567] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-20 23:01:18,924 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,925 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-20 23:01:18,925 INFO [Listener at localhost/33567] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-20 23:01:18,927 INFO [Listener at localhost/33567] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35407 2023-09-20 23:01:18,927 INFO [Listener at localhost/33567] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-20 23:01:18,928 INFO [Listener at localhost/33567] mob.MobFileCache(124): MobFileCache disabled 2023-09-20 23:01:18,929 INFO [Listener at localhost/33567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:18,932 INFO [Listener at localhost/33567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:18,934 INFO [Listener at localhost/33567] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35407 connecting to ZooKeeper ensemble=127.0.0.1:53756 2023-09-20 23:01:18,938 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:354070x0, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-20 23:01:18,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35407-0x100cb92c0690002 connected 2023-09-20 23:01:18,939 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-20 23:01:18,940 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 23:01:18,941 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-20 23:01:18,945 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35407 2023-09-20 23:01:18,945 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35407 2023-09-20 23:01:18,945 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35407 2023-09-20 23:01:18,946 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35407 2023-09-20 23:01:18,949 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35407 2023-09-20 23:01:18,961 INFO [Listener at localhost/33567] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-20 23:01:18,961 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,961 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,961 INFO [Listener at localhost/33567] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-20 23:01:18,961 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-20 23:01:18,961 INFO [Listener at localhost/33567] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-20 23:01:18,961 INFO [Listener at localhost/33567] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-20 23:01:18,963 INFO [Listener at localhost/33567] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42935 2023-09-20 23:01:18,963 INFO [Listener at localhost/33567] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-20 23:01:18,964 INFO [Listener at localhost/33567] mob.MobFileCache(124): MobFileCache disabled 2023-09-20 23:01:18,965 INFO [Listener at localhost/33567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:18,966 INFO [Listener at localhost/33567] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:18,968 INFO [Listener at localhost/33567] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42935 connecting to ZooKeeper ensemble=127.0.0.1:53756 2023-09-20 23:01:18,973 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:429350x0, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-20 23:01:18,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42935-0x100cb92c0690003 connected 2023-09-20 23:01:18,974 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-20 23:01:18,975 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 23:01:18,975 DEBUG [Listener at localhost/33567] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-20 23:01:18,976 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42935 2023-09-20 23:01:18,976 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42935 2023-09-20 23:01:18,976 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42935 2023-09-20 23:01:18,981 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42935 2023-09-20 23:01:18,981 DEBUG [Listener at localhost/33567] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42935 2023-09-20 23:01:18,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45915,1695250877567 2023-09-20 23:01:18,992 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-20 23:01:18,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45915,1695250877567 2023-09-20 23:01:19,013 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-20 23:01:19,013 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-20 23:01:19,013 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-20 23:01:19,013 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-20 23:01:19,014 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:01:19,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-20 23:01:19,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45915,1695250877567 from backup master directory 2023-09-20 23:01:19,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-20 23:01:19,020 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45915,1695250877567 2023-09-20 23:01:19,021 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-20 23:01:19,021 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-20 23:01:19,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45915,1695250877567 2023-09-20 23:01:19,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-20 23:01:19,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-20 23:01:19,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/hbase.id with ID: d4f44fba-6dc2-4f33-9128-a1faa03e27fb 2023-09-20 23:01:19,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-20 23:01:19,183 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:01:19,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6c4a0cc9 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:19,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@377522f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:19,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-20 23:01:19,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-20 23:01:19,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-20 23:01:19,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-20 23:01:19,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-20 23:01:19,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-20 23:01:19,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-20 23:01:19,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/data/master/store-tmp 2023-09-20 23:01:19,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:19,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-20 23:01:19,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 23:01:19,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 23:01:19,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-20 23:01:19,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 23:01:19,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 23:01:19,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-20 23:01:19,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/WALs/jenkins-hbase4.apache.org,45915,1695250877567 2023-09-20 23:01:19,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45915%2C1695250877567, suffix=, logDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/WALs/jenkins-hbase4.apache.org,45915,1695250877567, archiveDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/oldWALs, maxLogs=10 2023-09-20 23:01:19,482 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41377,DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4,DISK] 2023-09-20 23:01:19,482 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46001,DS-531e46ef-f8d5-4b9f-b0e6-824070080bad,DISK] 2023-09-20 23:01:19,482 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39553,DS-0d294203-1ead-4e43-973d-c79afa9617dc,DISK] 2023-09-20 23:01:19,493 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-20 23:01:19,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/WALs/jenkins-hbase4.apache.org,45915,1695250877567/jenkins-hbase4.apache.org%2C45915%2C1695250877567.1695250879437 2023-09-20 23:01:19,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39553,DS-0d294203-1ead-4e43-973d-c79afa9617dc,DISK], DatanodeInfoWithStorage[127.0.0.1:46001,DS-531e46ef-f8d5-4b9f-b0e6-824070080bad,DISK], DatanodeInfoWithStorage[127.0.0.1:41377,DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4,DISK]] 2023-09-20 23:01:19,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-20 23:01:19,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:19,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-20 23:01:19,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-20 23:01:19,643 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-20 23:01:19,649 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-20 23:01:19,677 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-20 23:01:19,690 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:19,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-20 23:01:19,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-20 23:01:19,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-20 23:01:19,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:01:19,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59880286, jitterRate=-0.1077142059803009}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:01:19,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-20 23:01:19,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-20 23:01:19,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-20 23:01:19,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-20 23:01:19,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-20 23:01:19,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-20 23:01:19,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-09-20 23:01:19,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-20 23:01:19,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-20 23:01:19,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-20 23:01:19,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-20 23:01:19,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-20 23:01:19,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-20 23:01:19,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-20 23:01:19,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-20 23:01:19,874 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:01:19,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-20 23:01:19,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-20 23:01:19,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-20 23:01:19,895 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-20 23:01:19,895 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-20 23:01:19,895 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-20 23:01:19,896 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:01:19,895 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-20 23:01:19,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45915,1695250877567, sessionid=0x100cb92c0690000, setting cluster-up flag (Was=false) 2023-09-20 23:01:19,919 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:01:19,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-20 23:01:19,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45915,1695250877567 2023-09-20 23:01:19,932 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:01:19,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-20 23:01:19,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45915,1695250877567 2023-09-20 23:01:19,944 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp 2023-09-20 23:01:19,986 INFO [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(951): ClusterId : d4f44fba-6dc2-4f33-9128-a1faa03e27fb 2023-09-20 23:01:19,988 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(951): ClusterId : d4f44fba-6dc2-4f33-9128-a1faa03e27fb 2023-09-20 23:01:19,987 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(951): ClusterId : d4f44fba-6dc2-4f33-9128-a1faa03e27fb 2023-09-20 23:01:19,996 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-20 23:01:19,996 DEBUG [RS:2;jenkins-hbase4:42935] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-20 23:01:19,996 DEBUG [RS:0;jenkins-hbase4:35755] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-20 23:01:20,004 DEBUG [RS:0;jenkins-hbase4:35755] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-20 23:01:20,005 DEBUG [RS:0;jenkins-hbase4:35755] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-20 23:01:20,005 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-20 23:01:20,005 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-20 23:01:20,007 DEBUG [RS:2;jenkins-hbase4:42935] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-20 23:01:20,008 DEBUG [RS:2;jenkins-hbase4:42935] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-20 23:01:20,011 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-20 23:01:20,013 DEBUG [RS:0;jenkins-hbase4:35755] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-20 23:01:20,016 DEBUG [RS:2;jenkins-hbase4:42935] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-20 23:01:20,016 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ReadOnlyZKClient(139): Connect 0x79ec310a to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:20,016 DEBUG [RS:0;jenkins-hbase4:35755] zookeeper.ReadOnlyZKClient(139): Connect 0x18138d6d to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:20,021 DEBUG [RS:2;jenkins-hbase4:42935] zookeeper.ReadOnlyZKClient(139): Connect 0x3dec1d76 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:20,039 DEBUG [RS:0;jenkins-hbase4:35755] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16d4701f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:20,040 DEBUG [RS:0;jenkins-hbase4:35755] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12ebe61d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-20 23:01:20,041 DEBUG [RS:1;jenkins-hbase4:35407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@772bc047, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:20,041 DEBUG [RS:1;jenkins-hbase4:35407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73145a7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-20 23:01:20,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-20 23:01:20,066 DEBUG [RS:2;jenkins-hbase4:42935] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@332be4bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:20,066 DEBUG [RS:2;jenkins-hbase4:42935] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37147606, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-20 23:01:20,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:20,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-20 23:01:20,088 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35755 2023-09-20 23:01:20,091 DEBUG [RS:2;jenkins-hbase4:42935] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42935 2023-09-20 23:01:20,093 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35407 2023-09-20 23:01:20,093 INFO [RS:2;jenkins-hbase4:42935] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-20 23:01:20,093 INFO [RS:0;jenkins-hbase4:35755] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-20 23:01:20,093 INFO [RS:1;jenkins-hbase4:35407] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-20 23:01:20,094 INFO [RS:1;jenkins-hbase4:35407] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-20 23:01:20,094 INFO [RS:0;jenkins-hbase4:35755] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-20 23:01:20,094 INFO [RS:2;jenkins-hbase4:42935] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-20 23:01:20,095 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-20 23:01:20,095 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-20 23:01:20,095 DEBUG [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-20 23:01:20,095 INFO [RS:1;jenkins-hbase4:35407] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:20,096 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1022): About to register with Master. 2023-09-20 23:01:20,096 INFO [RS:2;jenkins-hbase4:42935] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:20,096 DEBUG [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(1022): About to register with Master. 2023-09-20 23:01:20,097 INFO [RS:0;jenkins-hbase4:35755] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:20,097 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1022): About to register with Master. 2023-09-20 23:01:20,099 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45915,1695250877567 with isa=jenkins-hbase4.apache.org/172.31.14.131:35407, startcode=1695250878922 2023-09-20 23:01:20,099 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45915,1695250877567 with isa=jenkins-hbase4.apache.org/172.31.14.131:35755, startcode=1695250878873 2023-09-20 23:01:20,101 INFO [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45915,1695250877567 with isa=jenkins-hbase4.apache.org/172.31.14.131:42935, startcode=1695250878960 2023-09-20 23:01:20,119 DEBUG [RS:2;jenkins-hbase4:42935] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-20 23:01:20,119 DEBUG [RS:0;jenkins-hbase4:35755] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-20 23:01:20,119 DEBUG [RS:1;jenkins-hbase4:35407] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-20 23:01:20,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-20 23:01:20,177 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48529, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-20 23:01:20,177 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46683, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-20 23:01:20,177 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35801, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-20 23:01:20,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-20 23:01:20,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-20 23:01:20,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-20 23:01:20,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-20 23:01:20,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-20 23:01:20,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-20 23:01:20,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695250910180 2023-09-20 23:01:20,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-20 23:01:20,188 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-20 23:01:20,188 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45915] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-20 23:01:20,188 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-20 23:01:20,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-20 23:01:20,193 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-20 23:01:20,198 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45915] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-20 23:01:20,199 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45915] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-20 23:01:20,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-20 23:01:20,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-20 23:01:20,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-20 23:01:20,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-20 23:01:20,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-20 23:01:20,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-20 23:01:20,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-20 23:01:20,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-20 23:01:20,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-20 23:01:20,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695250880215,5,FailOnTimeoutGroup] 2023-09-20 23:01:20,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695250880215,5,FailOnTimeoutGroup] 2023-09-20 23:01:20,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-20 23:01:20,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,223 DEBUG [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(2830): Master is not running yet 2023-09-20 23:01:20,223 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(2830): Master is not running yet 2023-09-20 23:01:20,223 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(2830): Master is not running yet 2023-09-20 23:01:20,224 WARN [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-20 23:01:20,224 WARN [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-20 23:01:20,224 WARN [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-20 23:01:20,236 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-20 23:01:20,237 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-20 23:01:20,237 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:01:20,259 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:20,261 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-20 23:01:20,264 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/info 2023-09-20 23:01:20,264 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-20 23:01:20,265 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:20,266 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-20 23:01:20,268 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/rep_barrier 2023-09-20 23:01:20,268 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-20 23:01:20,269 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:20,270 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-20 23:01:20,272 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/table 2023-09-20 23:01:20,272 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-20 23:01:20,273 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:20,274 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740 2023-09-20 23:01:20,275 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740 2023-09-20 23:01:20,279 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-20 23:01:20,281 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-20 23:01:20,284 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:01:20,285 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60960223, jitterRate=-0.09162189066410065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-20 23:01:20,285 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-20 23:01:20,286 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-20 23:01:20,286 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-20 23:01:20,286 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-20 23:01:20,286 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-20 23:01:20,286 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-20 23:01:20,288 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-20 23:01:20,288 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-20 23:01:20,296 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-20 23:01:20,296 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-20 23:01:20,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-20 23:01:20,324 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-20 23:01:20,326 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45915,1695250877567 with isa=jenkins-hbase4.apache.org/172.31.14.131:35407, startcode=1695250878922 2023-09-20 23:01:20,326 INFO [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45915,1695250877567 with isa=jenkins-hbase4.apache.org/172.31.14.131:42935, startcode=1695250878960 2023-09-20 23:01:20,327 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45915,1695250877567 with isa=jenkins-hbase4.apache.org/172.31.14.131:35755, startcode=1695250878873 2023-09-20 23:01:20,329 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-20 23:01:20,333 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45915] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:20,338 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45915] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:20,339 DEBUG [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:01:20,339 DEBUG [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37461 2023-09-20 23:01:20,339 DEBUG [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-20 23:01:20,339 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45915] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:20,340 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:01:20,340 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37461 2023-09-20 23:01:20,340 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-20 23:01:20,341 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:01:20,341 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37461 2023-09-20 23:01:20,341 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-20 23:01:20,345 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 23:01:20,350 DEBUG [RS:2;jenkins-hbase4:42935] zookeeper.ZKUtil(162): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:20,350 WARN [RS:2;jenkins-hbase4:42935] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-20 23:01:20,350 INFO [RS:2;jenkins-hbase4:42935] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-20 23:01:20,350 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ZKUtil(162): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:20,350 DEBUG [RS:0;jenkins-hbase4:35755] zookeeper.ZKUtil(162): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:20,351 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35407,1695250878922] 2023-09-20 23:01:20,351 WARN [RS:0;jenkins-hbase4:35755] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-20 23:01:20,350 WARN [RS:1;jenkins-hbase4:35407] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-20 23:01:20,350 DEBUG [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:20,351 INFO [RS:1;jenkins-hbase4:35407] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-20 23:01:20,351 INFO [RS:0;jenkins-hbase4:35755] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-20 23:01:20,351 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:20,351 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:20,351 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42935,1695250878960] 2023-09-20 23:01:20,352 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35755,1695250878873] 2023-09-20 23:01:20,366 DEBUG [RS:2;jenkins-hbase4:42935] zookeeper.ZKUtil(162): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:20,366 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ZKUtil(162): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:20,366 DEBUG [RS:0;jenkins-hbase4:35755] zookeeper.ZKUtil(162): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:20,366 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ZKUtil(162): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:20,366 DEBUG [RS:2;jenkins-hbase4:42935] zookeeper.ZKUtil(162): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:20,367 DEBUG [RS:0;jenkins-hbase4:35755] zookeeper.ZKUtil(162): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:20,367 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ZKUtil(162): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:20,367 DEBUG [RS:2;jenkins-hbase4:42935] zookeeper.ZKUtil(162): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:20,367 DEBUG [RS:0;jenkins-hbase4:35755] zookeeper.ZKUtil(162): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:20,378 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-20 23:01:20,378 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-20 23:01:20,378 DEBUG [RS:2;jenkins-hbase4:42935] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-20 23:01:20,388 INFO [RS:0;jenkins-hbase4:35755] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-20 23:01:20,388 INFO [RS:2;jenkins-hbase4:42935] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-20 23:01:20,388 INFO [RS:1;jenkins-hbase4:35407] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-20 23:01:20,412 INFO [RS:0;jenkins-hbase4:35755] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-20 23:01:20,412 INFO [RS:1;jenkins-hbase4:35407] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-20 23:01:20,412 INFO [RS:2;jenkins-hbase4:42935] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-20 23:01:20,416 INFO [RS:2;jenkins-hbase4:42935] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-20 23:01:20,416 INFO [RS:1;jenkins-hbase4:35407] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-20 23:01:20,416 INFO [RS:0;jenkins-hbase4:35755] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-20 23:01:20,417 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,417 INFO [RS:2;jenkins-hbase4:42935] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,417 INFO [RS:0;jenkins-hbase4:35755] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,418 INFO [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-20 23:01:20,418 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-20 23:01:20,418 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-20 23:01:20,427 INFO [RS:2;jenkins-hbase4:42935] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,427 INFO [RS:0;jenkins-hbase4:35755] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,427 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,427 DEBUG [RS:2;jenkins-hbase4:42935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:2;jenkins-hbase4:42935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:2;jenkins-hbase4:42935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,427 DEBUG [RS:0;jenkins-hbase4:35755] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:2;jenkins-hbase4:42935] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:0;jenkins-hbase4:35755] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:0;jenkins-hbase4:35755] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:0;jenkins-hbase4:35755] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:0;jenkins-hbase4:35755] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-20 23:01:20,428 DEBUG [RS:0;jenkins-hbase4:35755] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-20 23:01:20,428 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,429 DEBUG [RS:0;jenkins-hbase4:35755] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,429 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,429 DEBUG [RS:0;jenkins-hbase4:35755] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,429 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,429 DEBUG [RS:0;jenkins-hbase4:35755] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,429 DEBUG [RS:1;jenkins-hbase4:35407] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,429 DEBUG [RS:0;jenkins-hbase4:35755] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,428 DEBUG [RS:2;jenkins-hbase4:42935] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,430 DEBUG [RS:2;jenkins-hbase4:42935] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-20 23:01:20,430 DEBUG [RS:2;jenkins-hbase4:42935] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,430 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,430 DEBUG [RS:2;jenkins-hbase4:42935] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,430 INFO [RS:0;jenkins-hbase4:35755] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,430 DEBUG [RS:2;jenkins-hbase4:42935] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,430 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,431 DEBUG [RS:2;jenkins-hbase4:42935] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-20 23:01:20,431 INFO [RS:0;jenkins-hbase4:35755] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,431 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,431 INFO [RS:0;jenkins-hbase4:35755] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,432 INFO [RS:2;jenkins-hbase4:42935] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,432 INFO [RS:2;jenkins-hbase4:42935] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,432 INFO [RS:2;jenkins-hbase4:42935] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,449 INFO [RS:1;jenkins-hbase4:35407] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-20 23:01:20,449 INFO [RS:0;jenkins-hbase4:35755] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-20 23:01:20,449 INFO [RS:2;jenkins-hbase4:42935] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-20 23:01:20,452 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35407,1695250878922-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,452 INFO [RS:0;jenkins-hbase4:35755] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35755,1695250878873-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,452 INFO [RS:2;jenkins-hbase4:42935] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42935,1695250878960-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,473 INFO [RS:0;jenkins-hbase4:35755] regionserver.Replication(203): jenkins-hbase4.apache.org,35755,1695250878873 started 2023-09-20 23:01:20,473 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35755,1695250878873, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35755, sessionid=0x100cb92c0690001 2023-09-20 23:01:20,474 DEBUG [RS:0;jenkins-hbase4:35755] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-20 23:01:20,474 DEBUG [RS:0;jenkins-hbase4:35755] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:20,474 DEBUG [RS:0;jenkins-hbase4:35755] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35755,1695250878873' 2023-09-20 23:01:20,474 DEBUG [RS:0;jenkins-hbase4:35755] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-20 23:01:20,474 INFO [RS:2;jenkins-hbase4:42935] regionserver.Replication(203): jenkins-hbase4.apache.org,42935,1695250878960 started 2023-09-20 23:01:20,474 INFO [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42935,1695250878960, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42935, sessionid=0x100cb92c0690003 2023-09-20 23:01:20,474 DEBUG [RS:2;jenkins-hbase4:42935] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-20 23:01:20,474 DEBUG [RS:2;jenkins-hbase4:42935] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:20,475 DEBUG [RS:2;jenkins-hbase4:42935] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42935,1695250878960' 2023-09-20 23:01:20,476 DEBUG [RS:2;jenkins-hbase4:42935] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-20 23:01:20,476 DEBUG [RS:0;jenkins-hbase4:35755] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-20 23:01:20,476 DEBUG [RS:2;jenkins-hbase4:42935] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-20 23:01:20,477 INFO [RS:1;jenkins-hbase4:35407] regionserver.Replication(203): jenkins-hbase4.apache.org,35407,1695250878922 started 2023-09-20 23:01:20,477 DEBUG [RS:0;jenkins-hbase4:35755] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-20 23:01:20,477 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35407,1695250878922, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35407, sessionid=0x100cb92c0690002 2023-09-20 23:01:20,477 DEBUG [RS:2;jenkins-hbase4:42935] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-20 23:01:20,477 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-20 23:01:20,477 DEBUG [RS:1;jenkins-hbase4:35407] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:20,477 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35407,1695250878922' 2023-09-20 23:01:20,477 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-20 23:01:20,477 DEBUG [RS:0;jenkins-hbase4:35755] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-20 23:01:20,477 DEBUG [RS:2;jenkins-hbase4:42935] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-20 23:01:20,478 DEBUG [RS:0;jenkins-hbase4:35755] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:20,478 DEBUG [RS:2;jenkins-hbase4:42935] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:20,478 DEBUG [RS:0;jenkins-hbase4:35755] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35755,1695250878873' 2023-09-20 23:01:20,478 DEBUG [RS:0;jenkins-hbase4:35755] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:20,478 DEBUG [RS:2;jenkins-hbase4:42935] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42935,1695250878960' 2023-09-20 23:01:20,479 DEBUG [RS:2;jenkins-hbase4:42935] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:20,479 DEBUG [RS:2;jenkins-hbase4:42935] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:20,480 DEBUG [RS:0;jenkins-hbase4:35755] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:20,481 DEBUG [jenkins-hbase4:45915] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-20 23:01:20,481 DEBUG [RS:0;jenkins-hbase4:35755] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-20 23:01:20,482 INFO [RS:0;jenkins-hbase4:35755] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-20 23:01:20,482 INFO [RS:0;jenkins-hbase4:35755] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-20 23:01:20,486 DEBUG [RS:2;jenkins-hbase4:42935] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-20 23:01:20,486 INFO [RS:2;jenkins-hbase4:42935] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-20 23:01:20,486 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-20 23:01:20,486 INFO [RS:2;jenkins-hbase4:42935] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-20 23:01:20,487 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-20 23:01:20,487 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-20 23:01:20,487 DEBUG [RS:1;jenkins-hbase4:35407] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:20,487 DEBUG [jenkins-hbase4:45915] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 23:01:20,487 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35407,1695250878922' 2023-09-20 23:01:20,488 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:20,488 DEBUG [RS:1;jenkins-hbase4:35407] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:20,489 DEBUG [RS:1;jenkins-hbase4:35407] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-20 23:01:20,489 INFO [RS:1;jenkins-hbase4:35407] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-20 23:01:20,489 INFO [RS:1;jenkins-hbase4:35407] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-20 23:01:20,495 DEBUG [jenkins-hbase4:45915] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 23:01:20,495 DEBUG [jenkins-hbase4:45915] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 23:01:20,495 DEBUG [jenkins-hbase4:45915] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 23:01:20,495 DEBUG [jenkins-hbase4:45915] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 23:01:20,497 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35755,1695250878873, state=OPENING 2023-09-20 23:01:20,508 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-20 23:01:20,509 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:01:20,510 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-20 23:01:20,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35755,1695250878873}] 2023-09-20 23:01:20,593 INFO [RS:2;jenkins-hbase4:42935] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42935%2C1695250878960, suffix=, logDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,42935,1695250878960, archiveDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/oldWALs, maxLogs=32 2023-09-20 23:01:20,593 INFO [RS:1;jenkins-hbase4:35407] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35407%2C1695250878922, suffix=, logDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,35407,1695250878922, archiveDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/oldWALs, maxLogs=32 2023-09-20 23:01:20,593 INFO [RS:0;jenkins-hbase4:35755] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35755%2C1695250878873, suffix=, logDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,35755,1695250878873, archiveDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/oldWALs, maxLogs=32 2023-09-20 23:01:20,620 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39553,DS-0d294203-1ead-4e43-973d-c79afa9617dc,DISK] 2023-09-20 23:01:20,620 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46001,DS-531e46ef-f8d5-4b9f-b0e6-824070080bad,DISK] 2023-09-20 23:01:20,620 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41377,DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4,DISK] 2023-09-20 23:01:20,621 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46001,DS-531e46ef-f8d5-4b9f-b0e6-824070080bad,DISK] 2023-09-20 23:01:20,622 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41377,DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4,DISK] 2023-09-20 23:01:20,630 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46001,DS-531e46ef-f8d5-4b9f-b0e6-824070080bad,DISK] 2023-09-20 23:01:20,630 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39553,DS-0d294203-1ead-4e43-973d-c79afa9617dc,DISK] 2023-09-20 23:01:20,631 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41377,DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4,DISK] 2023-09-20 23:01:20,637 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39553,DS-0d294203-1ead-4e43-973d-c79afa9617dc,DISK] 2023-09-20 23:01:20,646 INFO [RS:1;jenkins-hbase4:35407] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,35407,1695250878922/jenkins-hbase4.apache.org%2C35407%2C1695250878922.1695250880598 2023-09-20 23:01:20,648 INFO [RS:2;jenkins-hbase4:42935] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,42935,1695250878960/jenkins-hbase4.apache.org%2C42935%2C1695250878960.1695250880599 2023-09-20 23:01:20,648 DEBUG [RS:1;jenkins-hbase4:35407] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39553,DS-0d294203-1ead-4e43-973d-c79afa9617dc,DISK], DatanodeInfoWithStorage[127.0.0.1:41377,DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4,DISK], DatanodeInfoWithStorage[127.0.0.1:46001,DS-531e46ef-f8d5-4b9f-b0e6-824070080bad,DISK]] 2023-09-20 23:01:20,649 INFO [RS:0;jenkins-hbase4:35755] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,35755,1695250878873/jenkins-hbase4.apache.org%2C35755%2C1695250878873.1695250880598 2023-09-20 23:01:20,649 DEBUG [RS:2;jenkins-hbase4:42935] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39553,DS-0d294203-1ead-4e43-973d-c79afa9617dc,DISK], DatanodeInfoWithStorage[127.0.0.1:41377,DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4,DISK], DatanodeInfoWithStorage[127.0.0.1:46001,DS-531e46ef-f8d5-4b9f-b0e6-824070080bad,DISK]] 2023-09-20 23:01:20,650 DEBUG [RS:0;jenkins-hbase4:35755] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39553,DS-0d294203-1ead-4e43-973d-c79afa9617dc,DISK], DatanodeInfoWithStorage[127.0.0.1:41377,DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4,DISK], DatanodeInfoWithStorage[127.0.0.1:46001,DS-531e46ef-f8d5-4b9f-b0e6-824070080bad,DISK]] 2023-09-20 23:01:20,699 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:20,702 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 23:01:20,705 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 23:01:20,718 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-20 23:01:20,718 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-20 23:01:20,721 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35755%2C1695250878873.meta, suffix=.meta, logDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,35755,1695250878873, archiveDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/oldWALs, maxLogs=32 2023-09-20 23:01:20,739 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39553,DS-0d294203-1ead-4e43-973d-c79afa9617dc,DISK] 2023-09-20 23:01:20,739 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46001,DS-531e46ef-f8d5-4b9f-b0e6-824070080bad,DISK] 2023-09-20 23:01:20,739 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41377,DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4,DISK] 2023-09-20 23:01:20,745 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/WALs/jenkins-hbase4.apache.org,35755,1695250878873/jenkins-hbase4.apache.org%2C35755%2C1695250878873.meta.1695250880722.meta 2023-09-20 23:01:20,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41377,DS-9e9dcb7d-71b8-48c3-bb8f-fd873f3b52e4,DISK], DatanodeInfoWithStorage[127.0.0.1:39553,DS-0d294203-1ead-4e43-973d-c79afa9617dc,DISK], DatanodeInfoWithStorage[127.0.0.1:46001,DS-531e46ef-f8d5-4b9f-b0e6-824070080bad,DISK]] 2023-09-20 23:01:20,746 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-20 23:01:20,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-20 23:01:20,748 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:20,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-20 23:01:20,751 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-20 23:01:20,752 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-20 23:01:20,765 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-20 23:01:20,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:20,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-20 23:01:20,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-20 23:01:20,769 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-20 23:01:20,770 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/info 2023-09-20 23:01:20,770 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/info 2023-09-20 23:01:20,771 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-20 23:01:20,773 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:20,774 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-20 23:01:20,776 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/rep_barrier 2023-09-20 23:01:20,776 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/rep_barrier 2023-09-20 23:01:20,776 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-20 23:01:20,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:20,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-20 23:01:20,779 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/table 2023-09-20 23:01:20,779 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/table 2023-09-20 23:01:20,780 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-20 23:01:20,780 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:20,782 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740 2023-09-20 23:01:20,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740 2023-09-20 23:01:20,788 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-20 23:01:20,790 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-20 23:01:20,792 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59134397, jitterRate=-0.11882881820201874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-20 23:01:20,794 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-20 23:01:20,806 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695250880692 2023-09-20 23:01:20,824 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-20 23:01:20,825 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-20 23:01:20,826 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35755,1695250878873, state=OPEN 2023-09-20 23:01:20,829 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-20 23:01:20,829 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-20 23:01:20,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-20 23:01:20,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35755,1695250878873 in 316 msec 2023-09-20 23:01:20,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-20 23:01:20,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 528 msec 2023-09-20 23:01:20,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 769 msec 2023-09-20 23:01:20,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695250880846, completionTime=-1 2023-09-20 23:01:20,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-20 23:01:20,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-20 23:01:20,922 DEBUG [hconnection-0x3f712515-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:20,926 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:20,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-20 23:01:20,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695250940947 2023-09-20 23:01:20,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695251000947 2023-09-20 23:01:20,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 100 msec 2023-09-20 23:01:20,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45915,1695250877567-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45915,1695250877567-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45915,1695250877567-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45915, period=300000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-20 23:01:20,986 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-20 23:01:20,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-20 23:01:20,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-20 23:01:21,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-20 23:01:21,013 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 23:01:21,017 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 23:01:21,042 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:01:21,045 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b empty. 2023-09-20 23:01:21,046 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:01:21,046 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-20 23:01:21,083 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-20 23:01:21,086 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c72413fec41daeda57cd9b7e6e2e810b, NAME => 'hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:01:21,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:21,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c72413fec41daeda57cd9b7e6e2e810b, disabling compactions & flushes 2023-09-20 23:01:21,107 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:01:21,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:01:21,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. after waiting 0 ms 2023-09-20 23:01:21,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:01:21,107 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:01:21,108 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c72413fec41daeda57cd9b7e6e2e810b: 2023-09-20 23:01:21,112 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 23:01:21,127 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695250881115"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250881115"}]},"ts":"1695250881115"} 2023-09-20 23:01:21,154 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-20 23:01:21,156 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 23:01:21,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250881156"}]},"ts":"1695250881156"} 2023-09-20 23:01:21,164 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-20 23:01:21,168 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 23:01:21,169 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 23:01:21,169 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 23:01:21,169 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 23:01:21,169 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 23:01:21,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c72413fec41daeda57cd9b7e6e2e810b, ASSIGN}] 2023-09-20 23:01:21,175 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c72413fec41daeda57cd9b7e6e2e810b, ASSIGN 2023-09-20 23:01:21,176 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c72413fec41daeda57cd9b7e6e2e810b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35755,1695250878873; forceNewPlan=false, retain=false 2023-09-20 23:01:21,328 INFO [jenkins-hbase4:45915] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-20 23:01:21,329 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c72413fec41daeda57cd9b7e6e2e810b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:21,330 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695250881329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250881329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250881329"}]},"ts":"1695250881329"} 2023-09-20 23:01:21,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c72413fec41daeda57cd9b7e6e2e810b, server=jenkins-hbase4.apache.org,35755,1695250878873}] 2023-09-20 23:01:21,500 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:01:21,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c72413fec41daeda57cd9b7e6e2e810b, NAME => 'hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b.', STARTKEY => '', ENDKEY => ''} 2023-09-20 23:01:21,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. service=AccessControlService 2023-09-20 23:01:21,502 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:21,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:01:21,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:21,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:01:21,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:01:21,505 INFO [StoreOpener-c72413fec41daeda57cd9b7e6e2e810b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:01:21,507 DEBUG [StoreOpener-c72413fec41daeda57cd9b7e6e2e810b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b/info 2023-09-20 23:01:21,507 DEBUG [StoreOpener-c72413fec41daeda57cd9b7e6e2e810b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b/info 2023-09-20 23:01:21,508 INFO [StoreOpener-c72413fec41daeda57cd9b7e6e2e810b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c72413fec41daeda57cd9b7e6e2e810b columnFamilyName info 2023-09-20 23:01:21,509 INFO [StoreOpener-c72413fec41daeda57cd9b7e6e2e810b-1] regionserver.HStore(310): Store=c72413fec41daeda57cd9b7e6e2e810b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:21,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:01:21,512 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:01:21,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:01:21,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:01:21,520 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c72413fec41daeda57cd9b7e6e2e810b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67670031, jitterRate=0.008362039923667908}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:01:21,520 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c72413fec41daeda57cd9b7e6e2e810b: 2023-09-20 23:01:21,522 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b., pid=6, masterSystemTime=1695250881490 2023-09-20 23:01:21,526 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:01:21,526 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:01:21,527 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c72413fec41daeda57cd9b7e6e2e810b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:21,528 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695250881527"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250881527"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250881527"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250881527"}]},"ts":"1695250881527"} 2023-09-20 23:01:21,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-20 23:01:21,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c72413fec41daeda57cd9b7e6e2e810b, server=jenkins-hbase4.apache.org,35755,1695250878873 in 195 msec 2023-09-20 23:01:21,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-20 23:01:21,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c72413fec41daeda57cd9b7e6e2e810b, ASSIGN in 363 msec 2023-09-20 23:01:21,541 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 23:01:21,542 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250881541"}]},"ts":"1695250881541"} 2023-09-20 23:01:21,544 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-20 23:01:21,548 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 23:01:21,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 548 msec 2023-09-20 23:01:21,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-20 23:01:21,616 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-20 23:01:21,616 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:01:21,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-20 23:01:21,667 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-20 23:01:21,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-09-20 23:01:21,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-20 23:01:21,696 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-20 23:01:21,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-20 23:01:21,721 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-20 23:01:21,724 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-20 23:01:21,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.702sec 2023-09-20 23:01:21,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-20 23:01:21,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-20 23:01:21,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-20 23:01:21,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45915,1695250877567-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-20 23:01:21,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45915,1695250877567-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-20 23:01:21,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-20 23:01:21,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-20 23:01:21,766 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 23:01:21,767 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 23:01:21,770 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/hbase/acl/65403148c07c561bce9cf55676881f92 2023-09-20 23:01:21,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-20 23:01:21,771 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/hbase/acl/65403148c07c561bce9cf55676881f92 empty. 2023-09-20 23:01:21,773 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/hbase/acl/65403148c07c561bce9cf55676881f92 2023-09-20 23:01:21,773 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-20 23:01:21,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-20 23:01:21,796 DEBUG [Listener at localhost/33567] zookeeper.ReadOnlyZKClient(139): Connect 0x6bf08614 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:21,800 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-20 23:01:21,801 DEBUG [Listener at localhost/33567] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52492d35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:21,802 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 65403148c07c561bce9cf55676881f92, NAME => 'hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:01:21,828 DEBUG [hconnection-0x5f69858d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:21,830 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:21,831 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 65403148c07c561bce9cf55676881f92, disabling compactions & flushes 2023-09-20 23:01:21,831 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:01:21,831 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:01:21,831 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. after waiting 0 ms 2023-09-20 23:01:21,831 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:01:21,831 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:01:21,831 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 65403148c07c561bce9cf55676881f92: 2023-09-20 23:01:21,837 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 23:01:21,838 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695250881838"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250881838"}]},"ts":"1695250881838"} 2023-09-20 23:01:21,842 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-20 23:01:21,843 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 23:01:21,844 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250881843"}]},"ts":"1695250881843"} 2023-09-20 23:01:21,845 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:21,846 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-20 23:01:21,848 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45915,1695250877567 2023-09-20 23:01:21,848 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-20 23:01:21,848 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/test.cache.data in system properties and HBase conf 2023-09-20 23:01:21,848 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop.tmp.dir in system properties and HBase conf 2023-09-20 23:01:21,848 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop.log.dir in system properties and HBase conf 2023-09-20 23:01:21,848 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-20 23:01:21,848 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-20 23:01:21,848 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/nfs.dump.dir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/java.io.tmpdir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-20 23:01:21,849 INFO [Listener at localhost/33567] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-20 23:01:21,851 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 23:01:21,852 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 23:01:21,852 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 23:01:21,852 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 23:01:21,852 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 23:01:21,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=65403148c07c561bce9cf55676881f92, ASSIGN}] 2023-09-20 23:01:21,855 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=65403148c07c561bce9cf55676881f92, ASSIGN 2023-09-20 23:01:21,856 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=65403148c07c561bce9cf55676881f92, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35407,1695250878922; forceNewPlan=false, retain=false 2023-09-20 23:01:21,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-20 23:01:22,006 INFO [jenkins-hbase4:45915] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-20 23:01:22,008 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=65403148c07c561bce9cf55676881f92, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:22,008 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695250882008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250882008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250882008"}]},"ts":"1695250882008"} 2023-09-20 23:01:22,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 65403148c07c561bce9cf55676881f92, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:01:22,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-20 23:01:22,167 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:22,167 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 23:01:22,170 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 23:01:22,178 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:01:22,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 65403148c07c561bce9cf55676881f92, NAME => 'hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92.', STARTKEY => '', ENDKEY => ''} 2023-09-20 23:01:22,179 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. service=AccessControlService 2023-09-20 23:01:22,179 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:22,179 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 65403148c07c561bce9cf55676881f92 2023-09-20 23:01:22,179 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:22,179 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 65403148c07c561bce9cf55676881f92 2023-09-20 23:01:22,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 65403148c07c561bce9cf55676881f92 2023-09-20 23:01:22,182 INFO [StoreOpener-65403148c07c561bce9cf55676881f92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 65403148c07c561bce9cf55676881f92 2023-09-20 23:01:22,184 DEBUG [StoreOpener-65403148c07c561bce9cf55676881f92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/acl/65403148c07c561bce9cf55676881f92/l 2023-09-20 23:01:22,184 DEBUG [StoreOpener-65403148c07c561bce9cf55676881f92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/acl/65403148c07c561bce9cf55676881f92/l 2023-09-20 23:01:22,185 INFO [StoreOpener-65403148c07c561bce9cf55676881f92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65403148c07c561bce9cf55676881f92 columnFamilyName l 2023-09-20 23:01:22,186 INFO [StoreOpener-65403148c07c561bce9cf55676881f92-1] regionserver.HStore(310): Store=65403148c07c561bce9cf55676881f92/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:22,188 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/acl/65403148c07c561bce9cf55676881f92 2023-09-20 23:01:22,190 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/acl/65403148c07c561bce9cf55676881f92 2023-09-20 23:01:22,195 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 65403148c07c561bce9cf55676881f92 2023-09-20 23:01:22,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/acl/65403148c07c561bce9cf55676881f92/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:01:22,201 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 65403148c07c561bce9cf55676881f92; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69763291, jitterRate=0.03955404460430145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:01:22,202 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 65403148c07c561bce9cf55676881f92: 2023-09-20 23:01:22,203 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92., pid=11, masterSystemTime=1695250882167 2023-09-20 23:01:22,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:01:22,209 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:01:22,210 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=65403148c07c561bce9cf55676881f92, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:22,210 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695250882210"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250882210"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250882210"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250882210"}]},"ts":"1695250882210"} 2023-09-20 23:01:22,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-20 23:01:22,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 65403148c07c561bce9cf55676881f92, server=jenkins-hbase4.apache.org,35407,1695250878922 in 202 msec 2023-09-20 23:01:22,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-20 23:01:22,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=65403148c07c561bce9cf55676881f92, ASSIGN in 366 msec 2023-09-20 23:01:22,224 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 23:01:22,224 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250882224"}]},"ts":"1695250882224"} 2023-09-20 23:01:22,227 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-20 23:01:22,231 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 23:01:22,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 469 msec 2023-09-20 23:01:22,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-20 23:01:22,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-20 23:01:22,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-20 23:01:23,091 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 23:01:23,512 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 23:01:23,523 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40141_jobhistory____.42wyjp/webapp 2023-09-20 23:01:23,707 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-20 23:01:23,707 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-20 23:01:23,708 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-20 23:01:23,711 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-20 23:01:23,794 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:24,124 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:24,405 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-20 23:01:24,433 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40141 2023-09-20 23:01:24,587 WARN [Listener at jenkins-hbase4.apache.org/41161] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 23:01:24,847 WARN [Listener at jenkins-hbase4.apache.org/41161] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-20 23:01:24,847 INFO [Listener at jenkins-hbase4.apache.org/41161] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 23:01:24,854 INFO [Listener at jenkins-hbase4.apache.org/41161] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40389_cluster____.6tbdn8/webapp 2023-09-20 23:01:24,924 INFO [Listener at jenkins-hbase4.apache.org/41161] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-20 23:01:24,925 INFO [Listener at jenkins-hbase4.apache.org/41161] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-20 23:01:24,925 INFO [Listener at jenkins-hbase4.apache.org/41161] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-20 23:01:24,925 INFO [Listener at jenkins-hbase4.apache.org/41161] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-20 23:01:24,934 INFO [Listener at jenkins-hbase4.apache.org/41161] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:25,136 INFO [Listener at jenkins-hbase4.apache.org/41161] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:25,217 INFO [Listener at jenkins-hbase4.apache.org/41161] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:25,227 INFO [Listener at jenkins-hbase4.apache.org/41161] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40389 2023-09-20 23:01:25,719 WARN [Listener at jenkins-hbase4.apache.org/41361] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 23:01:25,752 WARN [Listener at jenkins-hbase4.apache.org/41361] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-20 23:01:25,753 INFO [Listener at jenkins-hbase4.apache.org/41361] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 23:01:25,762 INFO [Listener at jenkins-hbase4.apache.org/41361] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43377_node____g84p82/webapp 2023-09-20 23:01:25,861 INFO [Listener at jenkins-hbase4.apache.org/41361] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-20 23:01:25,861 INFO [Listener at jenkins-hbase4.apache.org/41361] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-20 23:01:25,861 INFO [Listener at jenkins-hbase4.apache.org/41361] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-20 23:01:25,861 INFO [Listener at jenkins-hbase4.apache.org/41361] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-20 23:01:25,872 INFO [Listener at jenkins-hbase4.apache.org/41361] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:25,899 INFO [Listener at jenkins-hbase4.apache.org/41361] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:26,007 INFO [Listener at jenkins-hbase4.apache.org/41361] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:26,021 INFO [Listener at jenkins-hbase4.apache.org/41361] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43377 2023-09-20 23:01:26,218 WARN [Listener at jenkins-hbase4.apache.org/44443] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-20 23:01:26,224 WARN [Listener at jenkins-hbase4.apache.org/44443] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-20 23:01:26,224 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): jetty-6.1.26 2023-09-20 23:01:26,231 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33741_node____k9xpea/webapp 2023-09-20 23:01:26,281 INFO [Listener at jenkins-hbase4.apache.org/44443] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-20 23:01:26,282 INFO [Listener at jenkins-hbase4.apache.org/44443] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-20 23:01:26,282 INFO [Listener at jenkins-hbase4.apache.org/44443] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-20 23:01:26,282 INFO [Listener at jenkins-hbase4.apache.org/44443] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-20 23:01:26,292 INFO [Listener at jenkins-hbase4.apache.org/44443] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:26,311 INFO [Listener at jenkins-hbase4.apache.org/44443] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:26,319 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 23:01:26,426 INFO [Listener at jenkins-hbase4.apache.org/44443] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-20 23:01:26,443 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33741 2023-09-20 23:01:26,471 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-20 23:01:26,472 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-20 23:01:26,473 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-20 23:01:26,478 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-20 23:01:26,480 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:01:26,546 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=98, ProcessCount=165, AvailableMemoryMB=4067 2023-09-20 23:01:26,546 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-09-20 23:01:26,560 DEBUG [Listener at jenkins-hbase4.apache.org/44443] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-20 23:01:26,566 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-20 23:01:26,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 23:01:26,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-20 23:01:26,576 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 23:01:26,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-20 23:01:26,579 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 23:01:26,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-20 23:01:26,583 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:26,583 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:26,585 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b empty. 2023-09-20 23:01:26,585 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853 empty. 2023-09-20 23:01:26,586 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:26,586 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:26,586 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-20 23:01:26,614 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-20 23:01:26,616 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 147b6505a263e7aa58f0f92f387e487b, NAME => 'testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:01:26,616 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => b1f4b04ec3dc64fb352fdd8c1fd15853, NAME => 'testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:01:26,654 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:26,656 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 147b6505a263e7aa58f0f92f387e487b, disabling compactions & flushes 2023-09-20 23:01:26,656 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:26,656 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:26,656 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. after waiting 0 ms 2023-09-20 23:01:26,656 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:26,656 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:26,656 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 147b6505a263e7aa58f0f92f387e487b: 2023-09-20 23:01:26,656 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:26,657 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing b1f4b04ec3dc64fb352fdd8c1fd15853, disabling compactions & flushes 2023-09-20 23:01:26,657 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:26,657 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:26,657 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. after waiting 0 ms 2023-09-20 23:01:26,657 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:26,658 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:26,658 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for b1f4b04ec3dc64fb352fdd8c1fd15853: 2023-09-20 23:01:26,665 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 23:01:26,666 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695250886666"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250886666"}]},"ts":"1695250886666"} 2023-09-20 23:01:26,666 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695250886666"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250886666"}]},"ts":"1695250886666"} 2023-09-20 23:01:26,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-20 23:01:26,713 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 23:01:26,714 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 23:01:26,715 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250886715"}]},"ts":"1695250886715"} 2023-09-20 23:01:26,717 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-20 23:01:26,722 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 23:01:26,723 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 23:01:26,723 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 23:01:26,724 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 23:01:26,724 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 23:01:26,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=147b6505a263e7aa58f0f92f387e487b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1f4b04ec3dc64fb352fdd8c1fd15853, ASSIGN}] 2023-09-20 23:01:26,726 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1f4b04ec3dc64fb352fdd8c1fd15853, ASSIGN 2023-09-20 23:01:26,727 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=147b6505a263e7aa58f0f92f387e487b, ASSIGN 2023-09-20 23:01:26,728 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1f4b04ec3dc64fb352fdd8c1fd15853, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35755,1695250878873; forceNewPlan=false, retain=false 2023-09-20 23:01:26,728 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=147b6505a263e7aa58f0f92f387e487b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35407,1695250878922; forceNewPlan=false, retain=false 2023-09-20 23:01:26,878 INFO [jenkins-hbase4:45915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 23:01:26,880 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b1f4b04ec3dc64fb352fdd8c1fd15853, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:26,880 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=147b6505a263e7aa58f0f92f387e487b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:26,881 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695250886880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250886880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250886880"}]},"ts":"1695250886880"} 2023-09-20 23:01:26,881 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695250886880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250886880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250886880"}]},"ts":"1695250886880"} 2023-09-20 23:01:26,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-20 23:01:26,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure b1f4b04ec3dc64fb352fdd8c1fd15853, server=jenkins-hbase4.apache.org,35755,1695250878873}] 2023-09-20 23:01:26,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 147b6505a263e7aa58f0f92f387e487b, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:01:27,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:27,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1f4b04ec3dc64fb352fdd8c1fd15853, NAME => 'testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 23:01:27,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. service=AccessControlService 2023-09-20 23:01:27,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:27,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:27,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:27,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:27,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:27,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:27,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 147b6505a263e7aa58f0f92f387e487b, NAME => 'testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 23:01:27,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. service=AccessControlService 2023-09-20 23:01:27,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:27,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:27,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:27,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:27,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:27,051 INFO [StoreOpener-b1f4b04ec3dc64fb352fdd8c1fd15853-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:27,057 INFO [StoreOpener-147b6505a263e7aa58f0f92f387e487b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:27,058 DEBUG [StoreOpener-b1f4b04ec3dc64fb352fdd8c1fd15853-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/cf 2023-09-20 23:01:27,058 DEBUG [StoreOpener-b1f4b04ec3dc64fb352fdd8c1fd15853-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/cf 2023-09-20 23:01:27,059 DEBUG [StoreOpener-147b6505a263e7aa58f0f92f387e487b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/cf 2023-09-20 23:01:27,059 DEBUG [StoreOpener-147b6505a263e7aa58f0f92f387e487b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/cf 2023-09-20 23:01:27,062 INFO [StoreOpener-b1f4b04ec3dc64fb352fdd8c1fd15853-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1f4b04ec3dc64fb352fdd8c1fd15853 columnFamilyName cf 2023-09-20 23:01:27,062 INFO [StoreOpener-147b6505a263e7aa58f0f92f387e487b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 147b6505a263e7aa58f0f92f387e487b columnFamilyName cf 2023-09-20 23:01:27,065 INFO [StoreOpener-147b6505a263e7aa58f0f92f387e487b-1] regionserver.HStore(310): Store=147b6505a263e7aa58f0f92f387e487b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:27,065 INFO [StoreOpener-b1f4b04ec3dc64fb352fdd8c1fd15853-1] regionserver.HStore(310): Store=b1f4b04ec3dc64fb352fdd8c1fd15853/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:27,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:27,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:27,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:27,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:27,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:27,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:27,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:01:27,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:01:27,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 147b6505a263e7aa58f0f92f387e487b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63095888, jitterRate=-0.05979800224304199}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:01:27,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 147b6505a263e7aa58f0f92f387e487b: 2023-09-20 23:01:27,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b1f4b04ec3dc64fb352fdd8c1fd15853; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66696940, jitterRate=-0.006138145923614502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:01:27,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b1f4b04ec3dc64fb352fdd8c1fd15853: 2023-09-20 23:01:27,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853., pid=15, masterSystemTime=1695250887036 2023-09-20 23:01:27,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b., pid=16, masterSystemTime=1695250887037 2023-09-20 23:01:27,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:27,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:27,097 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=147b6505a263e7aa58f0f92f387e487b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,098 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695250887097"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250887097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250887097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250887097"}]},"ts":"1695250887097"} 2023-09-20 23:01:27,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:27,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:27,100 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b1f4b04ec3dc64fb352fdd8c1fd15853, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,100 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695250887099"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250887099"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250887099"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250887099"}]},"ts":"1695250887099"} 2023-09-20 23:01:27,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-20 23:01:27,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 147b6505a263e7aa58f0f92f387e487b, server=jenkins-hbase4.apache.org,35407,1695250878922 in 216 msec 2023-09-20 23:01:27,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-20 23:01:27,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure b1f4b04ec3dc64fb352fdd8c1fd15853, server=jenkins-hbase4.apache.org,35755,1695250878873 in 220 msec 2023-09-20 23:01:27,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=147b6505a263e7aa58f0f92f387e487b, ASSIGN in 380 msec 2023-09-20 23:01:27,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-20 23:01:27,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1f4b04ec3dc64fb352fdd8c1fd15853, ASSIGN in 383 msec 2023-09-20 23:01:27,111 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 23:01:27,111 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250887111"}]},"ts":"1695250887111"} 2023-09-20 23:01:27,113 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-20 23:01:27,116 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 23:01:27,123 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-20 23:01:27,128 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:27,132 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:27,136 DEBUG [hconnection-0x38beb09c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:27,139 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-20 23:01:27,150 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-20 23:01:27,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-20 23:01:27,191 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:27,191 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:27,191 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:27,191 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:27,191 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:01:27,200 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:27,200 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:27,200 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:27,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-20 23:01:27,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-20 23:01:27,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-20 23:01:27,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-20 23:01:27,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 628 msec 2023-09-20 23:01:27,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-20 23:01:27,686 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-20 23:01:27,691 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-20 23:01:27,692 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:27,695 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:01:27,717 DEBUG [hconnection-0x5f69858d-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:27,720 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:27,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 23:01:27,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250887736 (current time:1695250887736). 2023-09-20 23:01:27,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:01:27,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x584127da to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:27,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7de31714, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:27,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:27,749 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:27,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x584127da to 127.0.0.1:53756 2023-09-20 23:01:27,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:01:27,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x23280fa9 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:27,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19c36b6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:27,760 DEBUG [hconnection-0x4da7a927-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:27,761 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:27,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:27,768 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:27,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23280fa9 to 127.0.0.1:53756 2023-09-20 23:01:27,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:01:27,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-20 23:01:27,777 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:01:27,777 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-20 23:01:27,777 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:01:27,778 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-20 23:01:27,778 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-20 23:01:27,778 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-20 23:01:27,778 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:01:27,778 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-20 23:01:27,778 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-20 23:01:27,778 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-20 23:01:27,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:01:27,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 23:01:27,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 23:01:27,820 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 23:01:27,821 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695251487821 2023-09-20 23:01:27,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 23:01:27,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-20 23:01:27,825 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 23:01:27,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 23:01:27,827 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:01:27,827 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:01:27,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-20 23:01:27,829 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 23:01:27,830 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695251487830 2023-09-20 23:01:27,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,861 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-20 23:01:27,861 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:27,862 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-20 23:01:27,862 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-20 23:01:27,863 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,863 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,869 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:27,869 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,869 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:27,869 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:27,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:27,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:27,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:27,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:27,869 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:27,869 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:27,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,870 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,870 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:01:27,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-20 23:01:27,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-20 23:01:27,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-20 23:01:27,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,871 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 23:01:27,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 23:01:27,871 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 23:01:27,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,877 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 23:01:27,877 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 23:01:27,877 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:27,877 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:27,878 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 23:01:27,878 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 23:01:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-20 23:01:27,877 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 23:01:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-20 23:01:27,878 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-20 23:01:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-20 23:01:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 23:01:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-20 23:01:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-20 23:01:27,882 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,883 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,883 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,883 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:27,883 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,883 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,883 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:27,883 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,883 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:27,883 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,883 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:27,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:27,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:27,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-20 23:01:27,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bdba76a[Count = 1] remaining members to acquire global barrier 2023-09-20 23:01:27,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:27,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:27,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:27,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:27,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:27,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-20 23:01:27,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bdba76a[Count = 0] remaining members to acquire global barrier 2023-09-20 23:01:27,889 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-20 23:01:27,889 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,892 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,892 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,892 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,893 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,893 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 23:01:27,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,893 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 23:01:27,893 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 23:01:27,893 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-20 23:01:27,893 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:01:27,893 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,893 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:01:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:01:27,899 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:01:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 23:01:27,899 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:01:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:01:27,900 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-20 23:01:27,900 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. started... 2023-09-20 23:01:27,901 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. started... 2023-09-20 23:01:27,903 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 147b6505a263e7aa58f0f92f387e487b: 2023-09-20 23:01:27,903 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1f4b04ec3dc64fb352fdd8c1fd15853: 2023-09-20 23:01:27,904 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,904 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,910 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:01:27,910 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:01:27,913 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:01:27,913 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:01:27,927 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:01:27,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 23:01:27,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:01:27,946 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:01:27,951 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. completed. 2023-09-20 23:01:27,951 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:27,952 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:01:27,952 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:01:27,952 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,952 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-20 23:01:27,952 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:01:27,952 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. completed. 2023-09-20 23:01:27,952 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:27,952 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:01:27,953 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:01:27,953 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,954 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-20 23:01:27,954 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:01:27,955 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,955 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 23:01:27,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:27,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:27,955 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:27,956 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-20 23:01:27,957 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 23:01:27,957 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,957 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:27,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:27,957 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-20 23:01:27,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:27,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:27,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35755,1695250878873': 2023-09-20 23:01:27,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-20 23:01:27,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:27,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:27,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:27,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:27,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:27,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35407,1695250878922': 2023-09-20 23:01:27,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-20 23:01:27,968 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-20 23:01:27,968 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:01:27,968 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:01:27,968 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,968 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:01:27,972 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:27,972 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:27,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:27,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:27,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:27,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,972 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:27,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:27,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:27,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:27,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:27,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:27,973 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:27,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,974 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:27,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,976 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,977 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:27,977 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,991 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,991 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,991 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:27,991 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:27,991 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:27,991 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:27,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:27,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:27,991 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,991 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:27,992 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:27,992 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:27,992 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-20 23:01:27,991 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:27,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:27,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:27,992 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:27,992 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:27,992 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:27,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:27,992 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:01:27,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:27,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:27,993 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:27,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:27,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:27,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:27,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 23:01:28,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:28,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:28,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:28,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-20 23:01:28,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:28,065 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:28,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695250887821Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695250888011 (+190 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695250888011Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695250888012 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695250888025 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695250888052 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695250888064 (+12 ms) 2023-09-20 23:01:28,068 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 23:01:28,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 245 msec 2023-09-20 23:01:28,146 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:01:28,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 23:01:28,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:01:28,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:01:28,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35755] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:01:28,174 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-20 23:01:28,174 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:28,174 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:01:28,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 23:01:28,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250888190 (current time:1695250888190). 2023-09-20 23:01:28,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:01:28,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x5029b2c9 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:28,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d0ddb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:28,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:28,202 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:28,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5029b2c9 to 127.0.0.1:53756 2023-09-20 23:01:28,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:01:28,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x04db4430 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:28,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19f91198, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:28,213 DEBUG [hconnection-0x18c54a75-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:28,215 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:28,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:28,222 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:28,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04db4430 to 127.0.0.1:53756 2023-09-20 23:01:28,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:01:28,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-20 23:01:28,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:01:28,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 23:01:28,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 23:01:28,229 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 23:01:28,230 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695251488230 2023-09-20 23:01:28,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-20 23:01:28,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-20 23:01:28,231 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:01:28,231 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:01:28,233 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-20 23:01:28,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 23:01:28,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-20 23:01:28,235 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 23:01:28,236 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695251488236 2023-09-20 23:01:28,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-20 23:01:28,257 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-20 23:01:28,257 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:28,258 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-20 23:01:28,258 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-20 23:01:28,259 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,259 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,260 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:28,260 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:28,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:28,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:28,260 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,260 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:28,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,261 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,261 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,262 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,262 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:01:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-20 23:01:28,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,263 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 23:01:28,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-20 23:01:28,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,263 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-20 23:01:28,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-20 23:01:28,263 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 23:01:28,263 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 23:01:28,263 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:28,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,263 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-20 23:01:28,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-20 23:01:28,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-20 23:01:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 23:01:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 23:01:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-20 23:01:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-20 23:01:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 23:01:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-20 23:01:28,266 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-20 23:01:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-20 23:01:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-20 23:01:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-20 23:01:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-20 23:01:28,270 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,270 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:28,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:28,270 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,272 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:28,273 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,273 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:28,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 23:01:28,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:28,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-20 23:01:28,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f79bd80[Count = 1] remaining members to acquire global barrier 2023-09-20 23:01:28,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:28,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:28,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:28,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:28,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 23:01:28,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:28,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-20 23:01:28,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f79bd80[Count = 0] remaining members to acquire global barrier 2023-09-20 23:01:28,278 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-20 23:01:28,278 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,282 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,283 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,283 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,283 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 23:01:28,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,283 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,283 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 23:01:28,283 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-20 23:01:28,283 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-20 23:01:28,283 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:28,283 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,283 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:01:28,283 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. started... 2023-09-20 23:01:28,283 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:01:28,283 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:28,284 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:01:28,283 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:01:28,284 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 147b6505a263e7aa58f0f92f387e487b 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-20 23:01:28,283 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:01:28,284 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:01:28,284 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. started... 2023-09-20 23:01:28,284 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b1f4b04ec3dc64fb352fdd8c1fd15853 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-20 23:01:28,286 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 23:01:28,286 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:28,287 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-20 23:01:28,332 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:01:28,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 23:01:28,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:01:28,334 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:01:28,426 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230920977471ca5d79452dba8d82b477b54ecf to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230920977471ca5d79452dba8d82b477b54ecf 2023-09-20 23:01:28,426 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309207e1567e7761c42f1bfe663e4c67ceeb0 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309207e1567e7761c42f1bfe663e4c67ceeb0 2023-09-20 23:01:28,459 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/.tmp/cf/2b3e666c3dea4bf2a5de8044dde717ca 2023-09-20 23:01:28,460 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/.tmp/cf/26afd14c64b445ddac1a3d64fdb843b0 2023-09-20 23:01:28,472 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/.tmp/cf/2b3e666c3dea4bf2a5de8044dde717ca as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/cf/2b3e666c3dea4bf2a5de8044dde717ca 2023-09-20 23:01:28,472 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/.tmp/cf/26afd14c64b445ddac1a3d64fdb843b0 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/cf/26afd14c64b445ddac1a3d64fdb843b0 2023-09-20 23:01:28,481 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/cf/26afd14c64b445ddac1a3d64fdb843b0, entries=48, sequenceid=6, filesize=13.0 K 2023-09-20 23:01:28,481 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/cf/2b3e666c3dea4bf2a5de8044dde717ca, entries=2, sequenceid=6, filesize=5.2 K 2023-09-20 23:01:28,486 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 147b6505a263e7aa58f0f92f387e487b in 202ms, sequenceid=6, compaction requested=false 2023-09-20 23:01:28,487 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-20 23:01:28,487 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for b1f4b04ec3dc64fb352fdd8c1fd15853 in 202ms, sequenceid=6, compaction requested=false 2023-09-20 23:01:28,487 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-20 23:01:28,489 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1f4b04ec3dc64fb352fdd8c1fd15853: 2023-09-20 23:01:28,489 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 147b6505a263e7aa58f0f92f387e487b: 2023-09-20 23:01:28,490 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-20 23:01:28,490 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-20 23:01:28,490 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:01:28,490 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:01:28,490 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/cf/26afd14c64b445ddac1a3d64fdb843b0] hfiles 2023-09-20 23:01:28,490 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/cf/2b3e666c3dea4bf2a5de8044dde717ca] hfiles 2023-09-20 23:01:28,490 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/cf/26afd14c64b445ddac1a3d64fdb843b0 for snapshot=snaptb0-testExportWithTargetName 2023-09-20 23:01:28,490 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/cf/2b3e666c3dea4bf2a5de8044dde717ca for snapshot=snaptb0-testExportWithTargetName 2023-09-20 23:01:28,515 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. completed. 2023-09-20 23:01:28,515 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. completed. 2023-09-20 23:01:28,515 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:28,516 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:01:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:01:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-20 23:01:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:01:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:01:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:01:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-20 23:01:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:01:28,518 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,518 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 23:01:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:28,518 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:28,518 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-20 23:01:28,519 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-20 23:01:28,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:28,519 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:28,519 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,519 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-20 23:01:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 23:01:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 23:01:28,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35407,1695250878922': 2023-09-20 23:01:28,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-20 23:01:28,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:28,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:28,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:28,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:28,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 23:01:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 23:01:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35755,1695250878873': 2023-09-20 23:01:28,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-20 23:01:28,529 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-20 23:01:28,529 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:01:28,529 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:01:28,529 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-20 23:01:28,529 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:01:28,532 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,532 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,532 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,532 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:28,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:28,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:28,532 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:28,532 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,532 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:28,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:28,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:28,533 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:28,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:28,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:28,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 23:01:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,534 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:01:28,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:28,534 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:28,535 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 23:01:28,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 23:01:28,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:01:28,536 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-20 23:01:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-20 23:01:28,539 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,539 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,539 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:28,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:28,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:28,550 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:28,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:28,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:28,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:28,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:28,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:28,550 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-20 23:01:28,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:28,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-20 23:01:28,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:28,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-20 23:01:28,551 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:28,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:01:28,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:28,551 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:28,552 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:28,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:28,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:28,552 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:28,552 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:28,552 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,552 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:28,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:28,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:28,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230920977471ca5d79452dba8d82b477b54ecf, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309207e1567e7761c42f1bfe663e4c67ceeb0] mob files 2023-09-20 23:01:28,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230920977471ca5d79452dba8d82b477b54ecf 2023-09-20 23:01:28,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309207e1567e7761c42f1bfe663e4c67ceeb0 2023-09-20 23:01:28,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-20 23:01:28,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-20 23:01:28,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,612 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-20 23:01:28,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695250888230Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695250888568 (+338 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695250888568Loading Region manifests for snaptb0-testExportWithTargetName at 1695250888568Writing data manifest for snaptb0-testExportWithTargetName at 1695250888573 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695250888598 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695250888611 (+13 ms) 2023-09-20 23:01:28,614 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-20 23:01:28,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 384 msec 2023-09-20 23:01:28,836 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:01:28,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-20 23:01:28,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:01:28,840 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250888840 2023-09-20 23:01:28,840 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37461, tgtDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250888840, rawTgtDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250888840, srcFsUri=hdfs://localhost:37461, srcDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:01:28,881 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:01:28,881 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_539536590_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250888840, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250888840/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-20 23:01:28,881 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611, snapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-20 23:01:28,903 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250888840/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-20 23:01:28,991 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:28,992 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:28,993 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:28,993 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:29,901 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-6952468872065266806.jar 2023-09-20 23:01:29,902 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:29,902 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:29,971 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-2031092090778094994.jar 2023-09-20 23:01:29,972 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:29,972 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:29,972 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:29,973 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:29,973 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:29,974 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:29,974 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 23:01:29,975 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 23:01:29,975 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 23:01:29,976 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 23:01:29,976 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 23:01:29,977 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 23:01:29,977 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 23:01:29,977 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 23:01:29,978 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 23:01:29,978 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 23:01:29,984 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:01:29,984 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:01:29,985 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:01:29,985 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:01:29,986 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:01:29,987 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:01:29,987 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:01:30,797 WARN [Listener at jenkins-hbase4.apache.org/44443] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 23:01:30,803 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-20 23:01:30,811 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-20 23:01:31,252 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:01:31,254 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:01:31,617 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0001_000001 (auth:SIMPLE) 2023-09-20 23:01:32,549 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 23:01:35,964 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0001_000001 (auth:SIMPLE) 2023-09-20 23:01:38,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0001_000001 (auth:SIMPLE) 2023-09-20 23:01:41,604 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0001_000001 (auth:SIMPLE) 2023-09-20 23:01:43,659 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 23:01:43,663 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 23:01:43,673 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-20 23:01:43,673 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 23:01:43,674 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 23:01:43,674 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-20 23:01:43,675 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-20 23:01:43,675 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-20 23:01:43,675 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250888840/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250888840/.hbase-snapshot/testExportWithTargetName 2023-09-20 23:01:43,676 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250888840/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-20 23:01:43,676 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250888840/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-20 23:01:43,686 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-20 23:01:43,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-20 23:01:43,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-20 23:01:43,703 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250903703"}]},"ts":"1695250903703"} 2023-09-20 23:01:43,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-20 23:01:43,707 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-20 23:01:43,709 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-20 23:01:43,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=147b6505a263e7aa58f0f92f387e487b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1f4b04ec3dc64fb352fdd8c1fd15853, UNASSIGN}] 2023-09-20 23:01:43,714 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=147b6505a263e7aa58f0f92f387e487b, UNASSIGN 2023-09-20 23:01:43,714 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1f4b04ec3dc64fb352fdd8c1fd15853, UNASSIGN 2023-09-20 23:01:43,715 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b1f4b04ec3dc64fb352fdd8c1fd15853, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:43,715 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=147b6505a263e7aa58f0f92f387e487b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:43,715 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695250903715"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250903715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250903715"}]},"ts":"1695250903715"} 2023-09-20 23:01:43,716 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695250903715"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250903715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250903715"}]},"ts":"1695250903715"} 2023-09-20 23:01:43,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure b1f4b04ec3dc64fb352fdd8c1fd15853, server=jenkins-hbase4.apache.org,35755,1695250878873}] 2023-09-20 23:01:43,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 147b6505a263e7aa58f0f92f387e487b, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:01:43,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-20 23:01:43,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:43,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:43,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 147b6505a263e7aa58f0f92f387e487b, disabling compactions & flushes 2023-09-20 23:01:43,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b1f4b04ec3dc64fb352fdd8c1fd15853, disabling compactions & flushes 2023-09-20 23:01:43,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:43,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:43,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:43,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:43,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. after waiting 0 ms 2023-09-20 23:01:43,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. after waiting 0 ms 2023-09-20 23:01:43,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:43,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:43,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:01:43,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:01:43,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:01:43,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:01:43,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853. 2023-09-20 23:01:43,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b. 2023-09-20 23:01:43,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b1f4b04ec3dc64fb352fdd8c1fd15853: 2023-09-20 23:01:43,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 147b6505a263e7aa58f0f92f387e487b: 2023-09-20 23:01:43,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:43,905 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=147b6505a263e7aa58f0f92f387e487b, regionState=CLOSED 2023-09-20 23:01:43,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:43,905 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695250903905"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250903905"}]},"ts":"1695250903905"} 2023-09-20 23:01:43,906 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b1f4b04ec3dc64fb352fdd8c1fd15853, regionState=CLOSED 2023-09-20 23:01:43,906 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695250903906"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250903906"}]},"ts":"1695250903906"} 2023-09-20 23:01:43,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-20 23:01:43,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 147b6505a263e7aa58f0f92f387e487b, server=jenkins-hbase4.apache.org,35407,1695250878922 in 188 msec 2023-09-20 23:01:43,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-20 23:01:43,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure b1f4b04ec3dc64fb352fdd8c1fd15853, server=jenkins-hbase4.apache.org,35755,1695250878873 in 191 msec 2023-09-20 23:01:43,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=147b6505a263e7aa58f0f92f387e487b, UNASSIGN in 199 msec 2023-09-20 23:01:43,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-20 23:01:43,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b1f4b04ec3dc64fb352fdd8c1fd15853, UNASSIGN in 200 msec 2023-09-20 23:01:43,916 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250903915"}]},"ts":"1695250903915"} 2023-09-20 23:01:43,917 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-20 23:01:43,919 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-20 23:01:43,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 226 msec 2023-09-20 23:01:44,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-20 23:01:44,007 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-20 23:01:44,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-20 23:01:44,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 23:01:44,022 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 23:01:44,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-20 23:01:44,024 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 23:01:44,027 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-20 23:01:44,030 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:44,030 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:44,031 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:44,031 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:44,031 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:44,031 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:44,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-20 23:01:44,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-20 23:01:44,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-20 23:01:44,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-20 23:01:44,033 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:44,033 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:44,033 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:44,033 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:44,033 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-20 23:01:44,033 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:44,033 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:44,034 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:44,035 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/recovered.edits] 2023-09-20 23:01:44,036 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/recovered.edits] 2023-09-20 23:01:44,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-20 23:01:44,044 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/cf/2b3e666c3dea4bf2a5de8044dde717ca to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/cf/2b3e666c3dea4bf2a5de8044dde717ca 2023-09-20 23:01:44,044 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/cf/26afd14c64b445ddac1a3d64fdb843b0 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/cf/26afd14c64b445ddac1a3d64fdb843b0 2023-09-20 23:01:44,048 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b/recovered.edits/9.seqid 2023-09-20 23:01:44,048 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853/recovered.edits/9.seqid 2023-09-20 23:01:44,049 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/147b6505a263e7aa58f0f92f387e487b 2023-09-20 23:01:44,049 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportWithTargetName/b1f4b04ec3dc64fb352fdd8c1fd15853 2023-09-20 23:01:44,049 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-20 23:01:44,050 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-20 23:01:44,051 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-20 23:01:44,054 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230920977471ca5d79452dba8d82b477b54ecf to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230920977471ca5d79452dba8d82b477b54ecf 2023-09-20 23:01:44,056 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309207e1567e7761c42f1bfe663e4c67ceeb0 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309207e1567e7761c42f1bfe663e4c67ceeb0 2023-09-20 23:01:44,056 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-20 23:01:44,059 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 23:01:44,080 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-20 23:01:44,083 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-20 23:01:44,084 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 23:01:44,084 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-20 23:01:44,085 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250904084"}]},"ts":"9223372036854775807"} 2023-09-20 23:01:44,085 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250904084"}]},"ts":"9223372036854775807"} 2023-09-20 23:01:44,087 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 23:01:44,087 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 147b6505a263e7aa58f0f92f387e487b, NAME => 'testtb-testExportWithTargetName,,1695250886571.147b6505a263e7aa58f0f92f387e487b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b1f4b04ec3dc64fb352fdd8c1fd15853, NAME => 'testtb-testExportWithTargetName,1,1695250886571.b1f4b04ec3dc64fb352fdd8c1fd15853.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 23:01:44,087 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-20 23:01:44,087 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695250904087"}]},"ts":"9223372036854775807"} 2023-09-20 23:01:44,089 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-20 23:01:44,091 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-20 23:01:44,093 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 78 msec 2023-09-20 23:01:44,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-20 23:01:44,141 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-20 23:01:44,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-20 23:01:44,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-20 23:01:44,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-20 23:01:44,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-20 23:01:44,203 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 706) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:42198 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-24508070_1 at /127.0.0.1:37452 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1511478988) connection to jenkins-hbase4.apache.org/172.31.14.131:41595 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1511478988) connection to jenkins-hbase4.apache.org/172.31.14.131:41361 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1511478988) connection to jenkins-hbase4.apache.org/172.31.14.131:38619 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3f712515-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:37480 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 98) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=3240 (was 4067) 2023-09-20 23:01:44,204 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-20 23:01:44,226 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=168, AvailableMemoryMB=3240 2023-09-20 23:01:44,226 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-20 23:01:44,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 23:01:44,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-20 23:01:44,233 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 23:01:44,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-20 23:01:44,236 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 23:01:44,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-20 23:01:44,238 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:44,239 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:44,239 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5 empty. 2023-09-20 23:01:44,239 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f empty. 2023-09-20 23:01:44,240 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:44,240 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:44,240 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-20 23:01:44,251 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-20 23:01:44,253 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f7319a02dc8ec0d6959758a7708c986f, NAME => 'testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:01:44,253 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3f3abe4583ebf647d372d3fdcbb3b0e5, NAME => 'testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:01:44,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:44,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:44,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f7319a02dc8ec0d6959758a7708c986f, disabling compactions & flushes 2023-09-20 23:01:44,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3f3abe4583ebf647d372d3fdcbb3b0e5, disabling compactions & flushes 2023-09-20 23:01:44,274 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:44,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:44,274 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:44,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. after waiting 0 ms 2023-09-20 23:01:44,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:44,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:44,275 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:44,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f7319a02dc8ec0d6959758a7708c986f: 2023-09-20 23:01:44,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. after waiting 0 ms 2023-09-20 23:01:44,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:44,275 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:44,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3f3abe4583ebf647d372d3fdcbb3b0e5: 2023-09-20 23:01:44,278 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 23:01:44,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695250904279"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250904279"}]},"ts":"1695250904279"} 2023-09-20 23:01:44,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695250904279"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250904279"}]},"ts":"1695250904279"} 2023-09-20 23:01:44,282 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 23:01:44,283 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 23:01:44,283 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250904283"}]},"ts":"1695250904283"} 2023-09-20 23:01:44,285 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-20 23:01:44,289 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 23:01:44,290 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 23:01:44,290 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 23:01:44,290 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 23:01:44,290 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 23:01:44,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f3abe4583ebf647d372d3fdcbb3b0e5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7319a02dc8ec0d6959758a7708c986f, ASSIGN}] 2023-09-20 23:01:44,293 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7319a02dc8ec0d6959758a7708c986f, ASSIGN 2023-09-20 23:01:44,293 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f3abe4583ebf647d372d3fdcbb3b0e5, ASSIGN 2023-09-20 23:01:44,294 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7319a02dc8ec0d6959758a7708c986f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42935,1695250878960; forceNewPlan=false, retain=false 2023-09-20 23:01:44,295 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f3abe4583ebf647d372d3fdcbb3b0e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35407,1695250878922; forceNewPlan=false, retain=false 2023-09-20 23:01:44,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-20 23:01:44,444 INFO [jenkins-hbase4:45915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 23:01:44,447 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3f3abe4583ebf647d372d3fdcbb3b0e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,447 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f7319a02dc8ec0d6959758a7708c986f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,447 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695250904447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250904447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250904447"}]},"ts":"1695250904447"} 2023-09-20 23:01:44,448 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695250904447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250904447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250904447"}]},"ts":"1695250904447"} 2023-09-20 23:01:44,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 3f3abe4583ebf647d372d3fdcbb3b0e5, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:01:44,451 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure f7319a02dc8ec0d6959758a7708c986f, server=jenkins-hbase4.apache.org,42935,1695250878960}] 2023-09-20 23:01:44,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-20 23:01:44,606 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,606 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 23:01:44,610 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 23:01:44,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:44,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f3abe4583ebf647d372d3fdcbb3b0e5, NAME => 'testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 23:01:44,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. service=AccessControlService 2023-09-20 23:01:44,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:44,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:44,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:44,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:44,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:44,616 INFO [StoreOpener-3f3abe4583ebf647d372d3fdcbb3b0e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:44,624 DEBUG [StoreOpener-3f3abe4583ebf647d372d3fdcbb3b0e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/cf 2023-09-20 23:01:44,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:44,624 DEBUG [StoreOpener-3f3abe4583ebf647d372d3fdcbb3b0e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/cf 2023-09-20 23:01:44,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f7319a02dc8ec0d6959758a7708c986f, NAME => 'testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 23:01:44,624 INFO [StoreOpener-3f3abe4583ebf647d372d3fdcbb3b0e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f3abe4583ebf647d372d3fdcbb3b0e5 columnFamilyName cf 2023-09-20 23:01:44,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. service=AccessControlService 2023-09-20 23:01:44,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:01:44,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:44,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:01:44,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:44,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:44,626 INFO [StoreOpener-3f3abe4583ebf647d372d3fdcbb3b0e5-1] regionserver.HStore(310): Store=3f3abe4583ebf647d372d3fdcbb3b0e5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:44,627 INFO [StoreOpener-f7319a02dc8ec0d6959758a7708c986f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:44,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:44,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:44,629 DEBUG [StoreOpener-f7319a02dc8ec0d6959758a7708c986f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/cf 2023-09-20 23:01:44,629 DEBUG [StoreOpener-f7319a02dc8ec0d6959758a7708c986f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/cf 2023-09-20 23:01:44,630 INFO [StoreOpener-f7319a02dc8ec0d6959758a7708c986f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7319a02dc8ec0d6959758a7708c986f columnFamilyName cf 2023-09-20 23:01:44,631 INFO [StoreOpener-f7319a02dc8ec0d6959758a7708c986f-1] regionserver.HStore(310): Store=f7319a02dc8ec0d6959758a7708c986f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:01:44,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:44,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:44,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:44,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:01:44,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3f3abe4583ebf647d372d3fdcbb3b0e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60989090, jitterRate=-0.09119173884391785}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:01:44,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3f3abe4583ebf647d372d3fdcbb3b0e5: 2023-09-20 23:01:44,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5., pid=30, masterSystemTime=1695250904603 2023-09-20 23:01:44,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:44,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:44,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:44,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:01:44,639 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3f3abe4583ebf647d372d3fdcbb3b0e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,640 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695250904639"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250904639"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250904639"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250904639"}]},"ts":"1695250904639"} 2023-09-20 23:01:44,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f7319a02dc8ec0d6959758a7708c986f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59775276, jitterRate=-0.10927897691726685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:01:44,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f7319a02dc8ec0d6959758a7708c986f: 2023-09-20 23:01:44,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f., pid=31, masterSystemTime=1695250904606 2023-09-20 23:01:44,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:44,646 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f7319a02dc8ec0d6959758a7708c986f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:44,647 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695250904646"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250904646"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250904646"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250904646"}]},"ts":"1695250904646"} 2023-09-20 23:01:44,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-20 23:01:44,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 3f3abe4583ebf647d372d3fdcbb3b0e5, server=jenkins-hbase4.apache.org,35407,1695250878922 in 194 msec 2023-09-20 23:01:44,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f3abe4583ebf647d372d3fdcbb3b0e5, ASSIGN in 358 msec 2023-09-20 23:01:44,651 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-20 23:01:44,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-20 23:01:44,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure f7319a02dc8ec0d6959758a7708c986f, server=jenkins-hbase4.apache.org,42935,1695250878960 in 198 msec 2023-09-20 23:01:44,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-20 23:01:44,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7319a02dc8ec0d6959758a7708c986f, ASSIGN in 363 msec 2023-09-20 23:01:44,656 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 23:01:44,656 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250904656"}]},"ts":"1695250904656"} 2023-09-20 23:01:44,657 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-20 23:01:44,660 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 23:01:44,660 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-20 23:01:44,662 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 23:01:44,663 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:44,663 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:44,663 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:44,663 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:44,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 23:01:44,664 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 23:01:44,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 23:01:44,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 23:01:44,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 434 msec 2023-09-20 23:01:44,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-20 23:01:44,840 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-20 23:01:44,843 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-20 23:01:44,843 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:44,844 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:01:44,855 DEBUG [hconnection-0x5f69858d-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:44,861 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:44,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:01:44,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250904865 (current time:1695250904865). 2023-09-20 23:01:44,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:01:44,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x0669cad0 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:44,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1039c7f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:44,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:44,874 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:44,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0669cad0 to 127.0.0.1:53756 2023-09-20 23:01:44,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:01:44,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x0e68a278 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:44,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@469fc62f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:44,883 DEBUG [hconnection-0x1847cf03-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:44,886 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:44,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:44,890 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:44,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e68a278 to 127.0.0.1:53756 2023-09-20 23:01:44,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:01:44,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 23:01:44,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:01:44,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:01:44,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:01:44,896 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:01:44,897 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695251504897 2023-09-20 23:01:44,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-20 23:01:44,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:01:44,899 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:01:44,899 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:01:44,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 23:01:44,900 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:01:44,902 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-20 23:01:44,902 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 23:01:44,903 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695251504903 2023-09-20 23:01:44,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,921 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-20 23:01:44,921 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:44,923 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-20 23:01:44,923 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-20 23:01:44,923 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,923 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,926 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,926 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:44,926 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:44,926 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:44,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:44,926 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:44,926 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,927 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,927 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:01:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-20 23:01:44,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,928 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 23:01:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-20 23:01:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,929 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 23:01:44,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-20 23:01:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 23:01:44,929 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 23:01:44,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 23:01:44,931 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:44,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,931 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 23:01:44,932 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 23:01:44,932 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:44,932 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-20 23:01:44,932 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 23:01:44,934 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-20 23:01:44,934 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-20 23:01:44,933 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-20 23:01:44,933 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 23:01:44,934 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-20 23:01:44,934 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-20 23:01:44,935 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,935 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:44,944 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,944 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,944 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:44,944 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,944 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:44,944 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:44,944 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:44,944 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,945 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:44,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:44,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:44,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-20 23:01:44,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8ecf3d8[Count = 1] remaining members to acquire global barrier 2023-09-20 23:01:44,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:44,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:44,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:44,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:44,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:44,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-20 23:01:44,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8ecf3d8[Count = 0] remaining members to acquire global barrier 2023-09-20 23:01:44,949 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-20 23:01:44,949 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,951 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,951 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,951 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,951 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:01:44,951 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,951 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:01:44,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,951 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-20 23:01:44,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,951 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:01:44,952 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:01:44,952 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:44,951 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:01:44,952 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. started... 2023-09-20 23:01:44,952 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:01:44,952 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,952 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:01:44,952 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3f3abe4583ebf647d372d3fdcbb3b0e5: 2023-09-20 23:01:44,952 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:01:44,952 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:44,952 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:01:44,952 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,952 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. started... 2023-09-20 23:01:44,952 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:01:44,952 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:01:44,954 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f7319a02dc8ec0d6959758a7708c986f: 2023-09-20 23:01:44,954 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 23:01:44,954 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:44,954 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-20 23:01:44,954 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,955 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:01:44,955 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:01:44,978 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. completed. 2023-09-20 23:01:44,978 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:44,979 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. completed. 2023-09-20 23:01:44,979 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:01:44,979 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:01:44,979 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:44,979 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,979 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:01:44,979 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:01:44,979 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,979 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-20 23:01:44,979 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-20 23:01:44,979 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:01:44,979 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:01:44,981 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 23:01:44,981 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,981 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:44,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:44,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:44,981 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-20 23:01:44,982 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,982 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 23:01:44,982 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:44,982 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-20 23:01:44,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:44,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:44,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:44,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:44,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35407,1695250878922': 2023-09-20 23:01:44,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-20 23:01:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:44,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:44,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:44,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:44,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42935,1695250878960': 2023-09-20 23:01:44,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-20 23:01:44,991 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-20 23:01:44,991 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:01:44,991 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:01:44,991 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,991 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:01:44,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:44,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:44,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:44,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:44,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:44,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,994 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:44,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:44,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,995 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:44,996 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:44,998 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:44,998 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:44,999 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:44,999 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:01:44,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 23:01:45,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:01:45,000 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:01:45,002 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,002 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:45,002 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:45,002 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:45,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:45,002 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,002 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:45,002 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,002 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:45,003 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:45,002 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,002 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:45,003 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-20 23:01:45,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:45,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:45,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:45,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,003 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:01:45,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:45,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:45,004 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,004 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:45,004 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:45,004 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,004 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,004 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,004 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 23:01:45,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,049 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-20 23:01:45,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,050 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-20 23:01:45,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695250904897Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695250905013 (+116 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695250905013Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695250905014 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695250905018 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695250905040 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695250905049 (+9 ms) 2023-09-20 23:01:45,053 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 23:01:45,056 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 155 msec 2023-09-20 23:01:45,200 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:01:45,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 23:01:45,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:01:45,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:01:45,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42935] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:01:45,214 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-20 23:01:45,214 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:45,215 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:01:45,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:01:45,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250905228 (current time:1695250905228). 2023-09-20 23:01:45,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:01:45,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x1f6f27ad to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:45,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@533629e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:45,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:45,248 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:45,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f6f27ad to 127.0.0.1:53756 2023-09-20 23:01:45,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:01:45,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x5badc2c3 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:01:45,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f02933c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:01:45,260 DEBUG [hconnection-0x3b975586-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:45,261 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:45,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:01:45,270 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:01:45,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5badc2c3 to 127.0.0.1:53756 2023-09-20 23:01:45,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:01:45,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 23:01:45,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:01:45,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:01:45,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:01:45,278 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:01:45,282 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695251505282 2023-09-20 23:01:45,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-20 23:01:45,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:01:45,284 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:01:45,284 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:01:45,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 23:01:45,286 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:01:45,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-09-20 23:01:45,289 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 23:01:45,290 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695251505290 2023-09-20 23:01:45,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-20 23:01:45,306 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-20 23:01:45,306 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:45,307 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-20 23:01:45,307 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-20 23:01:45,308 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,308 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,309 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:45,309 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:45,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:45,309 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:45,309 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:45,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:45,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:45,310 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:45,310 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,310 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,311 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:01:45,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-20 23:01:45,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 23:01:45,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-20 23:01:45,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-20 23:01:45,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-20 23:01:45,311 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 23:01:45,312 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:45,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,313 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 23:01:45,313 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-20 23:01:45,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,313 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 23:01:45,313 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-20 23:01:45,313 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-20 23:01:45,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-20 23:01:45,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-20 23:01:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 23:01:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-20 23:01:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:45,314 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:01:45,315 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 23:01:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-20 23:01:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-20 23:01:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-20 23:01:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-20 23:01:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-20 23:01:45,317 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,317 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,321 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:45,320 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,321 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,321 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:45,321 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:45,321 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:45,321 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:01:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 23:01:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:45,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-20 23:01:45,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e9af558[Count = 1] remaining members to acquire global barrier 2023-09-20 23:01:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 23:01:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:45,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-20 23:01:45,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e9af558[Count = 0] remaining members to acquire global barrier 2023-09-20 23:01:45,325 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-20 23:01:45,325 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,326 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,326 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,326 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,327 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:01:45,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,327 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,327 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:01:45,327 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:01:45,327 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,327 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:01:45,327 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:01:45,327 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:01:45,327 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. started... 2023-09-20 23:01:45,327 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:01:45,327 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,328 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:01:45,327 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:45,327 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-20 23:01:45,328 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. started... 2023-09-20 23:01:45,328 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:01:45,328 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f7319a02dc8ec0d6959758a7708c986f 1/1 column families, dataSize=2.67 KB heapSize=6.02 KB 2023-09-20 23:01:45,328 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3f3abe4583ebf647d372d3fdcbb3b0e5 1/1 column families, dataSize=601 B heapSize=1.52 KB 2023-09-20 23:01:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 23:01:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:45,332 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-20 23:01:45,373 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092093d2a02bba72417ebece8c5ab4f11947 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092093d2a02bba72417ebece8c5ab4f11947 2023-09-20 23:01:45,380 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230920ab45a58e3a0a4bb89cc42d8493662e74 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230920ab45a58e3a0a4bb89cc42d8493662e74 2023-09-20 23:01:45,384 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:01:45,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 23:01:45,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:01:45,392 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:01:45,395 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/.tmp/cf/df47f789939746228cca2b0a74f30c0d 2023-09-20 23:01:45,402 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/.tmp/cf/df47f789939746228cca2b0a74f30c0d as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/cf/df47f789939746228cca2b0a74f30c0d 2023-09-20 23:01:45,408 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=601, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/.tmp/cf/9e6d875677424db992a3e05644954d49 2023-09-20 23:01:45,409 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/cf/df47f789939746228cca2b0a74f30c0d, entries=41, sequenceid=6, filesize=11.8 K 2023-09-20 23:01:45,411 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.67 KB/2735, heapSize ~6 KB/6144, currentSize=0 B/0 for f7319a02dc8ec0d6959758a7708c986f in 83ms, sequenceid=6, compaction requested=false 2023-09-20 23:01:45,412 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f7319a02dc8ec0d6959758a7708c986f: 2023-09-20 23:01:45,412 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-20 23:01:45,412 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:01:45,413 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/cf/df47f789939746228cca2b0a74f30c0d] hfiles 2023-09-20 23:01:45,413 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/cf/df47f789939746228cca2b0a74f30c0d for snapshot=snaptb0-testExportFileSystemState 2023-09-20 23:01:45,416 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/.tmp/cf/9e6d875677424db992a3e05644954d49 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/cf/9e6d875677424db992a3e05644954d49 2023-09-20 23:01:45,422 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/cf/9e6d875677424db992a3e05644954d49, entries=9, sequenceid=6, filesize=6.4 K 2023-09-20 23:01:45,423 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~601 B/601, heapSize ~1.50 KB/1536, currentSize=0 B/0 for 3f3abe4583ebf647d372d3fdcbb3b0e5 in 95ms, sequenceid=6, compaction requested=false 2023-09-20 23:01:45,423 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3f3abe4583ebf647d372d3fdcbb3b0e5: 2023-09-20 23:01:45,423 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-20 23:01:45,423 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:01:45,423 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/cf/9e6d875677424db992a3e05644954d49] hfiles 2023-09-20 23:01:45,423 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/cf/9e6d875677424db992a3e05644954d49 for snapshot=snaptb0-testExportFileSystemState 2023-09-20 23:01:45,432 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. completed. 2023-09-20 23:01:45,432 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:01:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:01:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-20 23:01:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:01:45,446 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. completed. 2023-09-20 23:01:45,446 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:45,446 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:01:45,446 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:01:45,446 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,446 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-20 23:01:45,446 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:01:45,592 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:01:45,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 23:01:45,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:01:45,594 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-20 23:01:45,608 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 23:01:45,608 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,608 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:45,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:45,608 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-20 23:01:45,690 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-20 23:01:45,690 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:45,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:45,690 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,690 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-20 23:01:45,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:45,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 23:01:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 23:01:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42935,1695250878960': 2023-09-20 23:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-20 23:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:45,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:45,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:45,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 23:01:45,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 23:01:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35407,1695250878922': 2023-09-20 23:01:45,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-20 23:01:45,699 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-20 23:01:45,699 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:01:45,699 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:01:45,699 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-20 23:01:45,699 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:01:45,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:45,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:01:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:01:45,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,752 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:45,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,752 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:45,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:01:45,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,752 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 23:01:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:01:45,754 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 23:01:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:01:45,756 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-20 23:01:45,756 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,757 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,820 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:45,820 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:45,820 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:45,820 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:45,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:45,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:45,820 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:45,820 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:01:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:45,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:01:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:01:45,820 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:01:45,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-20 23:01:45,820 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:45,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-20 23:01:45,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:45,821 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:01:45,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-20 23:01:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:45,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:01:45,821 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,823 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,823 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,823 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:01:45,823 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,823 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:45,823 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:45,823 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,823 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:01:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:01:45,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092093d2a02bba72417ebece8c5ab4f11947, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230920ab45a58e3a0a4bb89cc42d8493662e74] mob files 2023-09-20 23:01:45,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092093d2a02bba72417ebece8c5ab4f11947 2023-09-20 23:01:45,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230920ab45a58e3a0a4bb89cc42d8493662e74 2023-09-20 23:01:45,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-20 23:01:45,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,868 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-20 23:01:45,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,868 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695250905282Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695250905834 (+552 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695250905834Loading Region manifests for snaptb0-testExportFileSystemState at 1695250905834Writing data manifest for snaptb0-testExportFileSystemState at 1695250905840 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695250905859 (+19 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695250905868 (+9 ms) 2023-09-20 23:01:45,871 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-20 23:01:45,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 587 msec 2023-09-20 23:01:45,894 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:01:45,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 23:01:45,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:01:45,895 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250905895 2023-09-20 23:01:45,895 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37461, tgtDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250905895, rawTgtDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250905895, srcFsUri=hdfs://localhost:37461, srcDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:01:45,920 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:01:45,920 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_71207905_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250905895, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250905895/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,920 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611, snapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-20 23:01:45,938 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250905895/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-20 23:01:45,969 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:45,969 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:45,970 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:45,970 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:46,862 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-6481402730132496911.jar 2023-09-20 23:01:46,863 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:46,863 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:46,930 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-6922479331318996467.jar 2023-09-20 23:01:46,930 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:46,931 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:46,931 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 23:01:46,933 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 23:01:46,933 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 23:01:46,934 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 23:01:46,934 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 23:01:46,934 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 23:01:46,935 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 23:01:46,935 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 23:01:46,935 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 23:01:46,936 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 23:01:46,936 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 23:01:46,937 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:01:46,937 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:01:46,938 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:01:46,938 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:01:46,938 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:01:46,939 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:01:46,939 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:01:47,435 WARN [Listener at jenkins-hbase4.apache.org/44443] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 23:01:47,438 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-20 23:01:47,440 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-20 23:01:47,816 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:01:47,816 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:01:47,822 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0001_000001 (auth:SIMPLE) 2023-09-20 23:01:48,581 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0002_000001 (auth:SIMPLE) 2023-09-20 23:01:49,501 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 23:01:52,621 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0002_000001 (auth:SIMPLE) 2023-09-20 23:01:54,844 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0002_000001 (auth:SIMPLE) 2023-09-20 23:01:58,001 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0002_000001 (auth:SIMPLE) 2023-09-20 23:01:59,653 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 23:01:59,654 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 23:01:59,663 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-20 23:01:59,663 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 23:01:59,663 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 23:01:59,664 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-20 23:01:59,664 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-20 23:01:59,664 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-20 23:01:59,664 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250905895/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250905895/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-20 23:01:59,665 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250905895/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-20 23:01:59,665 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250905895/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-20 23:01:59,672 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-20 23:01:59,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-20 23:01:59,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-20 23:01:59,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-20 23:01:59,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250919678"}]},"ts":"1695250919678"} 2023-09-20 23:01:59,680 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-20 23:01:59,682 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-20 23:01:59,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f3abe4583ebf647d372d3fdcbb3b0e5, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7319a02dc8ec0d6959758a7708c986f, UNASSIGN}] 2023-09-20 23:01:59,686 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f3abe4583ebf647d372d3fdcbb3b0e5, UNASSIGN 2023-09-20 23:01:59,686 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7319a02dc8ec0d6959758a7708c986f, UNASSIGN 2023-09-20 23:01:59,687 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3f3abe4583ebf647d372d3fdcbb3b0e5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:01:59,687 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f7319a02dc8ec0d6959758a7708c986f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:01:59,688 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695250919687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250919687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250919687"}]},"ts":"1695250919687"} 2023-09-20 23:01:59,688 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695250919687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250919687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250919687"}]},"ts":"1695250919687"} 2023-09-20 23:01:59,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 3f3abe4583ebf647d372d3fdcbb3b0e5, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:01:59,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure f7319a02dc8ec0d6959758a7708c986f, server=jenkins-hbase4.apache.org,42935,1695250878960}] 2023-09-20 23:01:59,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-20 23:01:59,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:59,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3f3abe4583ebf647d372d3fdcbb3b0e5, disabling compactions & flushes 2023-09-20 23:01:59,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:59,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:59,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:59,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. after waiting 0 ms 2023-09-20 23:01:59,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:59,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f7319a02dc8ec0d6959758a7708c986f, disabling compactions & flushes 2023-09-20 23:01:59,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:59,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:59,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. after waiting 0 ms 2023-09-20 23:01:59,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:59,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:01:59,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:01:59,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:01:59,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:01:59,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5. 2023-09-20 23:01:59,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f. 2023-09-20 23:01:59,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3f3abe4583ebf647d372d3fdcbb3b0e5: 2023-09-20 23:01:59,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f7319a02dc8ec0d6959758a7708c986f: 2023-09-20 23:01:59,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:59,858 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f7319a02dc8ec0d6959758a7708c986f, regionState=CLOSED 2023-09-20 23:01:59,858 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695250919858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250919858"}]},"ts":"1695250919858"} 2023-09-20 23:01:59,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:59,859 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3f3abe4583ebf647d372d3fdcbb3b0e5, regionState=CLOSED 2023-09-20 23:01:59,859 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695250919859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250919859"}]},"ts":"1695250919859"} 2023-09-20 23:01:59,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-20 23:01:59,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure f7319a02dc8ec0d6959758a7708c986f, server=jenkins-hbase4.apache.org,42935,1695250878960 in 169 msec 2023-09-20 23:01:59,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-20 23:01:59,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 3f3abe4583ebf647d372d3fdcbb3b0e5, server=jenkins-hbase4.apache.org,35407,1695250878922 in 171 msec 2023-09-20 23:01:59,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f7319a02dc8ec0d6959758a7708c986f, UNASSIGN in 179 msec 2023-09-20 23:01:59,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-20 23:01:59,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f3abe4583ebf647d372d3fdcbb3b0e5, UNASSIGN in 180 msec 2023-09-20 23:01:59,866 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250919866"}]},"ts":"1695250919866"} 2023-09-20 23:01:59,867 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-20 23:01:59,869 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-20 23:01:59,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 198 msec 2023-09-20 23:01:59,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-20 23:01:59,981 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-20 23:01:59,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-20 23:01:59,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 23:01:59,985 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 23:01:59,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-20 23:01:59,986 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 23:01:59,988 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-20 23:01:59,991 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 23:01:59,991 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:01:59,992 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 23:01:59,992 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 23:01:59,992 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 23:01:59,992 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:01:59,992 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-20 23:01:59,992 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-20 23:01:59,993 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 23:01:59,993 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:59,994 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-09-20 23:01:59,994 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-20 23:01:59,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:59,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-20 23:01:59,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:59,994 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-09-20 23:01:59,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:01:59,994 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-20 23:01:59,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-20 23:01:59,995 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/recovered.edits] 2023-09-20 23:01:59,995 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/recovered.edits] 2023-09-20 23:02:00,000 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/cf/9e6d875677424db992a3e05644954d49 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/cf/9e6d875677424db992a3e05644954d49 2023-09-20 23:02:00,000 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/cf/df47f789939746228cca2b0a74f30c0d to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/cf/df47f789939746228cca2b0a74f30c0d 2023-09-20 23:02:00,003 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5/recovered.edits/9.seqid 2023-09-20 23:02:00,003 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f/recovered.edits/9.seqid 2023-09-20 23:02:00,004 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/3f3abe4583ebf647d372d3fdcbb3b0e5 2023-09-20 23:02:00,004 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemState/f7319a02dc8ec0d6959758a7708c986f 2023-09-20 23:02:00,004 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-20 23:02:00,005 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-20 23:02:00,005 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-20 23:02:00,009 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092093d2a02bba72417ebece8c5ab4f11947 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023092093d2a02bba72417ebece8c5ab4f11947 2023-09-20 23:02:00,010 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230920ab45a58e3a0a4bb89cc42d8493662e74 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230920ab45a58e3a0a4bb89cc42d8493662e74 2023-09-20 23:02:00,011 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-20 23:02:00,013 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 23:02:00,015 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-20 23:02:00,018 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-20 23:02:00,019 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 23:02:00,019 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-20 23:02:00,019 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250920019"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:00,019 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250920019"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:00,021 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 23:02:00,021 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3f3abe4583ebf647d372d3fdcbb3b0e5, NAME => 'testtb-testExportFileSystemState,,1695250904227.3f3abe4583ebf647d372d3fdcbb3b0e5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f7319a02dc8ec0d6959758a7708c986f, NAME => 'testtb-testExportFileSystemState,1,1695250904227.f7319a02dc8ec0d6959758a7708c986f.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 23:02:00,021 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-20 23:02:00,021 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695250920021"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:00,023 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-20 23:02:00,025 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-20 23:02:00,027 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-09-20 23:02:00,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-20 23:02:00,096 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-20 23:02:00,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-20 23:02:00,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-20 23:02:00,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-20 23:02:00,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-20 23:02:00,133 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=769 (was 754) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:48232 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2078 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2003769267_1 at /127.0.0.1:48212 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1511478988) connection to jenkins-hbase4.apache.org/172.31.14.131:44443 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:33830 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2003769267_1 at /127.0.0.1:56708 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:56734 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1511478988) connection to jenkins-hbase4.apache.org/172.31.14.131:40723 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=943 (was 926) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 172) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3086 (was 3240) 2023-09-20 23:02:00,134 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-09-20 23:02:00,152 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=769, OpenFileDescriptor=943, MaxFileDescriptor=60000, SystemLoadAverage=189, ProcessCount=168, AvailableMemoryMB=3085 2023-09-20 23:02:00,152 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-09-20 23:02:00,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 23:02:00,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-20 23:02:00,157 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 23:02:00,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-20 23:02:00,158 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 23:02:00,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-20 23:02:00,161 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:00,161 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:00,161 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449 empty. 2023-09-20 23:02:00,161 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8 empty. 2023-09-20 23:02:00,162 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:00,162 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:00,162 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-20 23:02:00,172 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-20 23:02:00,173 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3bc68990aeb4de30c00b88480d6f3449, NAME => 'testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:02:00,174 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8428c5615579ddb180ff3b426794d1d8, NAME => 'testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:02:00,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:00,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 3bc68990aeb4de30c00b88480d6f3449, disabling compactions & flushes 2023-09-20 23:02:00,189 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:00,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:00,190 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. after waiting 0 ms 2023-09-20 23:02:00,190 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:00,190 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:00,190 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 3bc68990aeb4de30c00b88480d6f3449: 2023-09-20 23:02:00,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:00,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 8428c5615579ddb180ff3b426794d1d8, disabling compactions & flushes 2023-09-20 23:02:00,193 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:00,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:00,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. after waiting 0 ms 2023-09-20 23:02:00,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:00,193 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:00,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 8428c5615579ddb180ff3b426794d1d8: 2023-09-20 23:02:00,196 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 23:02:00,197 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695250920197"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250920197"}]},"ts":"1695250920197"} 2023-09-20 23:02:00,197 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695250920197"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250920197"}]},"ts":"1695250920197"} 2023-09-20 23:02:00,200 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 23:02:00,201 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 23:02:00,201 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250920201"}]},"ts":"1695250920201"} 2023-09-20 23:02:00,202 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-20 23:02:00,206 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 23:02:00,207 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 23:02:00,207 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 23:02:00,207 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 23:02:00,207 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 23:02:00,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3bc68990aeb4de30c00b88480d6f3449, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8428c5615579ddb180ff3b426794d1d8, ASSIGN}] 2023-09-20 23:02:00,210 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8428c5615579ddb180ff3b426794d1d8, ASSIGN 2023-09-20 23:02:00,211 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3bc68990aeb4de30c00b88480d6f3449, ASSIGN 2023-09-20 23:02:00,212 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3bc68990aeb4de30c00b88480d6f3449, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35755,1695250878873; forceNewPlan=false, retain=false 2023-09-20 23:02:00,212 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8428c5615579ddb180ff3b426794d1d8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42935,1695250878960; forceNewPlan=false, retain=false 2023-09-20 23:02:00,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-20 23:02:00,362 INFO [jenkins-hbase4:45915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 23:02:00,365 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8428c5615579ddb180ff3b426794d1d8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,365 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3bc68990aeb4de30c00b88480d6f3449, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,366 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695250920365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250920365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250920365"}]},"ts":"1695250920365"} 2023-09-20 23:02:00,366 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695250920365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250920365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250920365"}]},"ts":"1695250920365"} 2023-09-20 23:02:00,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 8428c5615579ddb180ff3b426794d1d8, server=jenkins-hbase4.apache.org,42935,1695250878960}] 2023-09-20 23:02:00,368 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 3bc68990aeb4de30c00b88480d6f3449, server=jenkins-hbase4.apache.org,35755,1695250878873}] 2023-09-20 23:02:00,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-20 23:02:00,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:00,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8428c5615579ddb180ff3b426794d1d8, NAME => 'testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 23:02:00,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. service=AccessControlService 2023-09-20 23:02:00,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:00,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:00,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:00,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:00,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:00,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:00,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3bc68990aeb4de30c00b88480d6f3449, NAME => 'testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 23:02:00,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. service=AccessControlService 2023-09-20 23:02:00,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:00,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:00,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:00,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:00,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:00,525 INFO [StoreOpener-8428c5615579ddb180ff3b426794d1d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:00,526 INFO [StoreOpener-3bc68990aeb4de30c00b88480d6f3449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:00,526 DEBUG [StoreOpener-8428c5615579ddb180ff3b426794d1d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/cf 2023-09-20 23:02:00,526 DEBUG [StoreOpener-8428c5615579ddb180ff3b426794d1d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/cf 2023-09-20 23:02:00,527 INFO [StoreOpener-8428c5615579ddb180ff3b426794d1d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8428c5615579ddb180ff3b426794d1d8 columnFamilyName cf 2023-09-20 23:02:00,527 DEBUG [StoreOpener-3bc68990aeb4de30c00b88480d6f3449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/cf 2023-09-20 23:02:00,527 DEBUG [StoreOpener-3bc68990aeb4de30c00b88480d6f3449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/cf 2023-09-20 23:02:00,527 INFO [StoreOpener-3bc68990aeb4de30c00b88480d6f3449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bc68990aeb4de30c00b88480d6f3449 columnFamilyName cf 2023-09-20 23:02:00,528 INFO [StoreOpener-8428c5615579ddb180ff3b426794d1d8-1] regionserver.HStore(310): Store=8428c5615579ddb180ff3b426794d1d8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:00,528 INFO [StoreOpener-3bc68990aeb4de30c00b88480d6f3449-1] regionserver.HStore(310): Store=3bc68990aeb4de30c00b88480d6f3449/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:00,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:00,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:00,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:00,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:00,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:00,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:00,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:02:00,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:02:00,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8428c5615579ddb180ff3b426794d1d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74181091, jitterRate=0.10538439452648163}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:00,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8428c5615579ddb180ff3b426794d1d8: 2023-09-20 23:02:00,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3bc68990aeb4de30c00b88480d6f3449; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58929930, jitterRate=-0.12187561392784119}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:00,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3bc68990aeb4de30c00b88480d6f3449: 2023-09-20 23:02:00,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449., pid=46, masterSystemTime=1695250920521 2023-09-20 23:02:00,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8., pid=45, masterSystemTime=1695250920519 2023-09-20 23:02:00,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:00,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:00,538 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3bc68990aeb4de30c00b88480d6f3449, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,538 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695250920538"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250920538"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250920538"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250920538"}]},"ts":"1695250920538"} 2023-09-20 23:02:00,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:00,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:00,539 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8428c5615579ddb180ff3b426794d1d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,539 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695250920539"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250920539"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250920539"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250920539"}]},"ts":"1695250920539"} 2023-09-20 23:02:00,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-20 23:02:00,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 3bc68990aeb4de30c00b88480d6f3449, server=jenkins-hbase4.apache.org,35755,1695250878873 in 172 msec 2023-09-20 23:02:00,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-20 23:02:00,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 8428c5615579ddb180ff3b426794d1d8, server=jenkins-hbase4.apache.org,42935,1695250878960 in 174 msec 2023-09-20 23:02:00,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3bc68990aeb4de30c00b88480d6f3449, ASSIGN in 334 msec 2023-09-20 23:02:00,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-20 23:02:00,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8428c5615579ddb180ff3b426794d1d8, ASSIGN in 336 msec 2023-09-20 23:02:00,546 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 23:02:00,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250920546"}]},"ts":"1695250920546"} 2023-09-20 23:02:00,548 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-20 23:02:00,550 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 23:02:00,550 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-20 23:02:00,552 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-20 23:02:00,553 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:00,553 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:00,553 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:00,553 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:00,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:00,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:00,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:00,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:00,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 401 msec 2023-09-20 23:02:00,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-20 23:02:00,762 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-20 23:02:00,764 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-20 23:02:00,764 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:00,767 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:02:00,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 23:02:00,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250920778 (current time:1695250920778). 2023-09-20 23:02:00,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:02:00,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x1af5a85e to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:00,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e0aaa03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:00,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:00,793 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:00,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1af5a85e to 127.0.0.1:53756 2023-09-20 23:02:00,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:00,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x034215fc to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:00,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34c2fa92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:00,805 DEBUG [hconnection-0x6f4314bb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:00,808 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:00,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:00,815 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:00,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x034215fc to 127.0.0.1:53756 2023-09-20 23:02:00,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:00,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-20 23:02:00,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:02:00,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 23:02:00,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 23:02:00,821 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 23:02:00,822 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695251520822 2023-09-20 23:02:00,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 23:02:00,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-20 23:02:00,823 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:02:00,824 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:02:00,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 23:02:00,825 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 23:02:00,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-20 23:02:00,828 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 23:02:00,828 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695251520828 2023-09-20 23:02:00,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,842 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-20 23:02:00,842 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:00,843 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-20 23:02:00,843 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-20 23:02:00,844 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,844 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,846 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:00,846 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:00,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:00,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:00,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:00,846 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,846 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:00,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,847 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,847 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,847 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,848 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:02:00,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-20 23:02:00,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-20 23:02:00,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-20 23:02:00,848 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 23:02:00,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,848 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 23:02:00,848 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 23:02:00,848 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:00,848 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 23:02:00,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,850 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 23:02:00,850 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:00,850 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 23:02:00,851 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 23:02:00,850 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 23:02:00,851 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:00,851 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-20 23:02:00,851 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-20 23:02:00,854 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-20 23:02:00,854 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 23:02:00,854 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-20 23:02:00,854 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-20 23:02:00,854 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-20 23:02:00,856 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,856 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,856 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:00,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:00,857 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,857 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:00,857 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,857 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,857 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:00,857 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:00,857 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,857 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:00,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-20 23:02:00,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c4ddeb6[Count = 1] remaining members to acquire global barrier 2023-09-20 23:02:00,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:00,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:00,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:00,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:00,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:00,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-20 23:02:00,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c4ddeb6[Count = 0] remaining members to acquire global barrier 2023-09-20 23:02:00,862 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-20 23:02:00,862 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,863 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,863 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,863 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,863 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 23:02:00,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,863 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-20 23:02:00,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,863 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:02:00,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,863 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,863 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 23:02:00,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,863 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 23:02:00,864 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:00,864 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:00,864 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:00,864 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:00,864 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,864 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:00,864 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. started... 2023-09-20 23:02:00,864 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:00,864 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. started... 2023-09-20 23:02:00,864 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3bc68990aeb4de30c00b88480d6f3449: 2023-09-20 23:02:00,865 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8428c5615579ddb180ff3b426794d1d8: 2023-09-20 23:02:00,864 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:02:00,865 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,865 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,865 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:00,866 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:00,866 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:02:00,866 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:02:00,872 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 23:02:00,872 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:00,872 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-20 23:02:00,882 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. completed. 2023-09-20 23:02:00,882 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:00,882 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:00,882 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:00,882 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,882 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-20 23:02:00,882 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:02:00,882 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. completed. 2023-09-20 23:02:00,882 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:00,882 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:00,882 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:00,882 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,882 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-20 23:02:00,882 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:02:00,884 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 23:02:00,884 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,884 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:00,884 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-20 23:02:00,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:00,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:00,885 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,885 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 23:02:00,885 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:00,885 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-20 23:02:00,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:00,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:00,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:00,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35755,1695250878873': 2023-09-20 23:02:00,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-20 23:02:00,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:00,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:00,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:00,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:00,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42935,1695250878960': 2023-09-20 23:02:00,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-20 23:02:00,892 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-20 23:02:00,892 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:02:00,892 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:02:00,892 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,892 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:02:00,893 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,893 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,893 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,893 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,894 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:00,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:00,894 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,894 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:00,894 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:00,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:00,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,895 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,895 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:00,898 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,899 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,899 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,903 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,903 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:00,903 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:00,903 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:00,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:00,903 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:00,903 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:00,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:00,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:00,903 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:00,903 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:00,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:00,903 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:00,904 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-20 23:02:00,904 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,904 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:00,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:00,904 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:00,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:00,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:02:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:00,905 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:00,905 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,905 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:00,905 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:00,905 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,905 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 23:02:00,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,924 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:00,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-20 23:02:00,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:02:00,925 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:02:00,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,934 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-20 23:02:00,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,934 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:00,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695250920822Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695250920915 (+93 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695250920915Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695250920915Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695250920920 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695250920927 (+7 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695250920934 (+7 ms) 2023-09-20 23:02:00,939 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 23:02:00,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 116 msec 2023-09-20 23:02:01,125 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:01,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-20 23:02:01,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:02:01,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35755] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:02:01,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42935] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:02:01,133 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-20 23:02:01,134 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:01,134 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:02:01,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 23:02:01,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250921144 (current time:1695250921144). 2023-09-20 23:02:01,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:02:01,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x41e96e64 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:01,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d3edb3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:01,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:01,158 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:01,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41e96e64 to 127.0.0.1:53756 2023-09-20 23:02:01,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:01,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x13fbd151 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:01,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@196b1704, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:01,168 DEBUG [hconnection-0x297c83c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:01,170 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:01,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:01,175 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:01,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13fbd151 to 127.0.0.1:53756 2023-09-20 23:02:01,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:01,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-20 23:02:01,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:02:01,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 23:02:01,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 23:02:01,180 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 23:02:01,181 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695251521181 2023-09-20 23:02:01,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-20 23:02:01,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-20 23:02:01,182 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:02:01,183 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:02:01,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 23:02:01,184 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-20 23:02:01,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-20 23:02:01,186 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 23:02:01,187 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695251521187 2023-09-20 23:02:01,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-20 23:02:01,197 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-20 23:02:01,197 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:01,199 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-20 23:02:01,199 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-20 23:02:01,199 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,199 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,200 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:01,200 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:01,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:01,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:01,200 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:01,200 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:01,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:01,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,201 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,201 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,201 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,201 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:02:01,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-20 23:02:01,202 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 23:02:01,202 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-20 23:02:01,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-20 23:02:01,203 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 23:02:01,203 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-20 23:02:01,203 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:01,203 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:01,203 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 23:02:01,205 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 23:02:01,205 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-20 23:02:01,204 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-20 23:02:01,205 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-20 23:02:01,205 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-20 23:02:01,205 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-20 23:02:01,206 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-20 23:02:01,205 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-20 23:02:01,207 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,207 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,207 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:01,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:01,209 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,209 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,209 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:01,209 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,209 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:01,209 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:01,209 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,209 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:01,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:01,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 23:02:01,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:01,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-20 23:02:01,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57097da6[Count = 1] remaining members to acquire global barrier 2023-09-20 23:02:01,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:01,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:01,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:01,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:01,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 23:02:01,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:01,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-20 23:02:01,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57097da6[Count = 0] remaining members to acquire global barrier 2023-09-20 23:02:01,213 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-20 23:02:01,213 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,216 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,216 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,216 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,216 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,216 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 23:02:01,216 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 23:02:01,217 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,217 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:02:01,217 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:01,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,217 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:01,217 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:01,217 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-20 23:02:01,217 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. started... 2023-09-20 23:02:01,217 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:02:01,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,217 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-20 23:02:01,217 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3bc68990aeb4de30c00b88480d6f3449 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-20 23:02:01,219 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 23:02:01,219 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:01,219 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-20 23:02:01,222 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:01,222 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:01,222 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:01,223 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. started... 2023-09-20 23:02:01,223 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8428c5615579ddb180ff3b426794d1d8 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-20 23:02:01,247 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230920c287a5685a1143b7bfb6143a7ee39b74 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230920c287a5685a1143b7bfb6143a7ee39b74 2023-09-20 23:02:01,253 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309203bb918e108c94709a747296efdbc67b0 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309203bb918e108c94709a747296efdbc67b0 2023-09-20 23:02:01,259 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/.tmp/cf/3edf9f3ad4534ceb95b8c34cfde13a00 2023-09-20 23:02:01,272 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/.tmp/cf/3edf9f3ad4534ceb95b8c34cfde13a00 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/cf/3edf9f3ad4534ceb95b8c34cfde13a00 2023-09-20 23:02:01,277 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/cf/3edf9f3ad4534ceb95b8c34cfde13a00, entries=2, sequenceid=6, filesize=5.2 K 2023-09-20 23:02:01,278 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 3bc68990aeb4de30c00b88480d6f3449 in 61ms, sequenceid=6, compaction requested=false 2023-09-20 23:02:01,278 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-20 23:02:01,278 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3bc68990aeb4de30c00b88480d6f3449: 2023-09-20 23:02:01,279 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-20 23:02:01,279 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:01,279 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/cf/3edf9f3ad4534ceb95b8c34cfde13a00] hfiles 2023-09-20 23:02:01,279 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/cf/3edf9f3ad4534ceb95b8c34cfde13a00 for snapshot=snaptb0-testConsecutiveExports 2023-09-20 23:02:01,283 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:01,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-20 23:02:01,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:02:01,284 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:02:01,285 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. completed. 2023-09-20 23:02:01,285 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:01,286 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:01,286 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:01,286 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,286 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-20 23:02:01,286 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:02:01,287 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 23:02:01,287 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,287 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:01,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:01,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:01,288 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-20 23:02:01,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:01,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:01,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 23:02:01,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:01,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 23:02:01,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35755,1695250878873': 2023-09-20 23:02:01,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-20 23:02:01,484 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:01,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-20 23:02:01,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:02:01,486 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-20 23:02:01,669 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/.tmp/cf/e2cb9b6aa58c4cae8e5be1b444938576 2023-09-20 23:02:01,675 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/.tmp/cf/e2cb9b6aa58c4cae8e5be1b444938576 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/cf/e2cb9b6aa58c4cae8e5be1b444938576 2023-09-20 23:02:01,680 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/cf/e2cb9b6aa58c4cae8e5be1b444938576, entries=48, sequenceid=6, filesize=12.9 K 2023-09-20 23:02:01,681 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 8428c5615579ddb180ff3b426794d1d8 in 458ms, sequenceid=6, compaction requested=false 2023-09-20 23:02:01,683 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8428c5615579ddb180ff3b426794d1d8: 2023-09-20 23:02:01,683 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-20 23:02:01,683 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:01,683 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/cf/e2cb9b6aa58c4cae8e5be1b444938576] hfiles 2023-09-20 23:02:01,683 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/cf/e2cb9b6aa58c4cae8e5be1b444938576 for snapshot=snaptb0-testConsecutiveExports 2023-09-20 23:02:01,691 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. completed. 2023-09-20 23:02:01,691 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-20 23:02:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:02:01,693 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,693 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-20 23:02:01,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:01,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:01,694 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:01,694 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-20 23:02:01,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 23:02:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 23:02:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42935,1695250878960': 2023-09-20 23:02:01,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-20 23:02:01,698 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-20 23:02:01,698 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:02:01,698 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:02:01,698 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-20 23:02:01,698 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:02:01,700 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,700 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:01,701 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:01,701 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,701 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,701 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:01,701 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,701 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:01,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 23:02:01,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:01,702 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:01,702 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 23:02:01,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:01,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-20 23:02:01,707 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,707 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,707 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:01,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:01,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,714 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:01,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:01,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:01,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:01,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:01,714 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-20 23:02:01,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:01,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,714 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:01,717 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:01,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-20 23:02:01,717 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:01,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-20 23:02:01,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:01,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:01,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:02:01,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:01,717 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:01,717 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:01,717 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,717 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309203bb918e108c94709a747296efdbc67b0, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230920c287a5685a1143b7bfb6143a7ee39b74] mob files 2023-09-20 23:02:01,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309203bb918e108c94709a747296efdbc67b0 2023-09-20 23:02:01,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230920c287a5685a1143b7bfb6143a7ee39b74 2023-09-20 23:02:01,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-20 23:02:01,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-20 23:02:01,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,748 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695250921181Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695250921725 (+544 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695250921725Loading Region manifests for snaptb0-testConsecutiveExports at 1695250921725Writing data manifest for snaptb0-testConsecutiveExports at 1695250921731 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695250921739 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695250921747 (+8 ms) 2023-09-20 23:02:01,750 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-20 23:02:01,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 568 msec 2023-09-20 23:02:01,786 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:01,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-20 23:02:01,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:02:01,788 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788 2023-09-20 23:02:01,788 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788, srcFsUri=hdfs://localhost:37461, srcDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:02:01,810 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:02:01,810 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1107e029, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,810 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611, snapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-20 23:02:01,819 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 23:02:01,830 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:01,831 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:01,831 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:01,832 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:02,709 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-7260243970421193297.jar 2023-09-20 23:02:02,710 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:02,710 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:02,776 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-575597229051106255.jar 2023-09-20 23:02:02,777 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:02,777 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:02,778 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:02,778 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:02,778 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:02,779 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:02,779 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 23:02:02,779 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 23:02:02,780 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 23:02:02,780 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 23:02:02,781 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 23:02:02,781 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 23:02:02,781 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 23:02:02,782 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 23:02:02,782 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 23:02:02,783 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 23:02:02,783 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:02,783 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:02,784 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:02,784 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:02,784 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:02,785 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:02,786 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:03,143 WARN [Listener at jenkins-hbase4.apache.org/44443] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 23:02:03,146 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-20 23:02:03,148 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-20 23:02:04,182 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:02:04,183 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:02:04,185 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0002_000001 (auth:SIMPLE) 2023-09-20 23:02:04,981 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0003_000001 (auth:SIMPLE) 2023-09-20 23:02:05,446 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 23:02:08,714 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0003_000001 (auth:SIMPLE) 2023-09-20 23:02:10,923 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0003_000001 (auth:SIMPLE) 2023-09-20 23:02:13,239 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0003_000001 (auth:SIMPLE) 2023-09-20 23:02:14,304 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 23:02:14,304 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 23:02:14,308 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-20 23:02:14,308 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 23:02:14,309 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 23:02:14,309 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-20 23:02:14,311 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-20 23:02:14,312 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-20 23:02:14,312 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3210aa1a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-20 23:02:14,312 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-20 23:02:14,312 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-20 23:02:14,313 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788, srcFsUri=hdfs://localhost:37461, srcDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:02:14,335 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:02:14,335 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@267fed8c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 23:02:14,335 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611, snapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-20 23:02:14,346 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-20 23:02:14,358 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:14,359 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:14,359 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:14,360 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:15,253 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-6015413530884838475.jar 2023-09-20 23:02:15,254 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:15,254 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:15,320 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-7547498513202848863.jar 2023-09-20 23:02:15,321 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:15,321 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:15,322 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:15,322 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:15,322 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:15,323 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:15,323 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 23:02:15,323 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 23:02:15,324 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 23:02:15,324 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 23:02:15,324 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 23:02:15,325 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 23:02:15,325 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 23:02:15,326 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 23:02:15,326 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 23:02:15,327 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 23:02:15,327 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:15,327 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:15,328 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:15,328 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:15,328 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:15,329 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:15,330 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:15,687 WARN [Listener at jenkins-hbase4.apache.org/44443] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 23:02:15,689 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-20 23:02:15,691 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-20 23:02:19,409 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:02:19,409 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:02:19,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0003_000001 (auth:SIMPLE) 2023-09-20 23:02:20,194 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0004_000001 (auth:SIMPLE) 2023-09-20 23:02:23,899 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0004_000001 (auth:SIMPLE) 2023-09-20 23:02:26,103 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0004_000001 (auth:SIMPLE) 2023-09-20 23:02:28,287 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0004_000001 (auth:SIMPLE) 2023-09-20 23:02:29,852 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 23:02:29,853 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 23:02:29,856 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-20 23:02:29,856 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 23:02:29,856 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 23:02:29,856 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-20 23:02:29,860 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-20 23:02:29,860 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-20 23:02:29,860 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3210aa1a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-20 23:02:29,860 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-20 23:02:29,860 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/local-export-1695250921788/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-20 23:02:29,873 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-20 23:02:29,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-20 23:02:29,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-20 23:02:29,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-20 23:02:29,878 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250949878"}]},"ts":"1695250949878"} 2023-09-20 23:02:29,879 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-20 23:02:29,882 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-20 23:02:29,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3bc68990aeb4de30c00b88480d6f3449, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8428c5615579ddb180ff3b426794d1d8, UNASSIGN}] 2023-09-20 23:02:29,884 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3bc68990aeb4de30c00b88480d6f3449, UNASSIGN 2023-09-20 23:02:29,884 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8428c5615579ddb180ff3b426794d1d8, UNASSIGN 2023-09-20 23:02:29,885 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3bc68990aeb4de30c00b88480d6f3449, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:29,885 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8428c5615579ddb180ff3b426794d1d8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:29,885 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695250949885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250949885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250949885"}]},"ts":"1695250949885"} 2023-09-20 23:02:29,885 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695250949885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250949885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250949885"}]},"ts":"1695250949885"} 2023-09-20 23:02:29,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 3bc68990aeb4de30c00b88480d6f3449, server=jenkins-hbase4.apache.org,35755,1695250878873}] 2023-09-20 23:02:29,887 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 8428c5615579ddb180ff3b426794d1d8, server=jenkins-hbase4.apache.org,42935,1695250878960}] 2023-09-20 23:02:29,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-20 23:02:30,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:30,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:30,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8428c5615579ddb180ff3b426794d1d8, disabling compactions & flushes 2023-09-20 23:02:30,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3bc68990aeb4de30c00b88480d6f3449, disabling compactions & flushes 2023-09-20 23:02:30,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:30,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:30,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:30,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:30,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. after waiting 0 ms 2023-09-20 23:02:30,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:30,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. after waiting 0 ms 2023-09-20 23:02:30,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:30,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:02:30,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:02:30,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:02:30,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:02:30,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8. 2023-09-20 23:02:30,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8428c5615579ddb180ff3b426794d1d8: 2023-09-20 23:02:30,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449. 2023-09-20 23:02:30,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3bc68990aeb4de30c00b88480d6f3449: 2023-09-20 23:02:30,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:30,053 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8428c5615579ddb180ff3b426794d1d8, regionState=CLOSED 2023-09-20 23:02:30,053 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695250950053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250950053"}]},"ts":"1695250950053"} 2023-09-20 23:02:30,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:30,054 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3bc68990aeb4de30c00b88480d6f3449, regionState=CLOSED 2023-09-20 23:02:30,054 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695250950054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250950054"}]},"ts":"1695250950054"} 2023-09-20 23:02:30,056 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-20 23:02:30,056 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 8428c5615579ddb180ff3b426794d1d8, server=jenkins-hbase4.apache.org,42935,1695250878960 in 168 msec 2023-09-20 23:02:30,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-20 23:02:30,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 3bc68990aeb4de30c00b88480d6f3449, server=jenkins-hbase4.apache.org,35755,1695250878873 in 169 msec 2023-09-20 23:02:30,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8428c5615579ddb180ff3b426794d1d8, UNASSIGN in 174 msec 2023-09-20 23:02:30,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-20 23:02:30,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3bc68990aeb4de30c00b88480d6f3449, UNASSIGN in 175 msec 2023-09-20 23:02:30,059 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250950059"}]},"ts":"1695250950059"} 2023-09-20 23:02:30,061 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-20 23:02:30,062 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-20 23:02:30,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 190 msec 2023-09-20 23:02:30,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-20 23:02:30,179 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-20 23:02:30,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-20 23:02:30,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 23:02:30,183 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 23:02:30,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-20 23:02:30,184 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 23:02:30,188 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-20 23:02:30,191 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 23:02:30,191 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 23:02:30,191 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 23:02:30,191 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 23:02:30,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-20 23:02:30,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-20 23:02:30,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-20 23:02:30,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-20 23:02:30,192 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:30,192 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:30,193 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 23:02:30,193 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 23:02:30,193 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 23:02:30,193 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:30,193 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-20 23:02:30,193 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:30,193 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:30,194 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:30,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-20 23:02:30,195 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/recovered.edits] 2023-09-20 23:02:30,195 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/recovered.edits] 2023-09-20 23:02:30,200 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/cf/3edf9f3ad4534ceb95b8c34cfde13a00 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/cf/3edf9f3ad4534ceb95b8c34cfde13a00 2023-09-20 23:02:30,200 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/cf/e2cb9b6aa58c4cae8e5be1b444938576 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/cf/e2cb9b6aa58c4cae8e5be1b444938576 2023-09-20 23:02:30,203 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449/recovered.edits/9.seqid 2023-09-20 23:02:30,203 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8/recovered.edits/9.seqid 2023-09-20 23:02:30,203 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/3bc68990aeb4de30c00b88480d6f3449 2023-09-20 23:02:30,203 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testConsecutiveExports/8428c5615579ddb180ff3b426794d1d8 2023-09-20 23:02:30,203 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-20 23:02:30,204 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-20 23:02:30,204 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-20 23:02:30,207 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309203bb918e108c94709a747296efdbc67b0 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309203bb918e108c94709a747296efdbc67b0 2023-09-20 23:02:30,209 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230920c287a5685a1143b7bfb6143a7ee39b74 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230920c287a5685a1143b7bfb6143a7ee39b74 2023-09-20 23:02:30,209 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-20 23:02:30,211 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 23:02:30,213 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-20 23:02:30,215 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-20 23:02:30,216 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 23:02:30,216 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-20 23:02:30,216 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250950216"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:30,217 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250950216"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:30,218 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 23:02:30,218 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3bc68990aeb4de30c00b88480d6f3449, NAME => 'testtb-testConsecutiveExports,,1695250920153.3bc68990aeb4de30c00b88480d6f3449.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8428c5615579ddb180ff3b426794d1d8, NAME => 'testtb-testConsecutiveExports,1,1695250920153.8428c5615579ddb180ff3b426794d1d8.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 23:02:30,218 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-20 23:02:30,218 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695250950218"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:30,220 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-20 23:02:30,222 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-20 23:02:30,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-09-20 23:02:30,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-20 23:02:30,296 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-20 23:02:30,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-20 23:02:30,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-20 23:02:30,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-20 23:02:30,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-20 23:02:30,332 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 769), OpenFileDescriptor=904 (was 943), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=121 (was 189), ProcessCount=168 (was 168), AvailableMemoryMB=2997 (was 3085) 2023-09-20 23:02:30,332 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-20 23:02:30,350 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=121, ProcessCount=168, AvailableMemoryMB=2996 2023-09-20 23:02:30,350 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-20 23:02:30,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 23:02:30,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:30,355 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 23:02:30,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-20 23:02:30,356 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 23:02:30,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-20 23:02:30,359 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:30,359 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:30,359 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca empty. 2023-09-20 23:02:30,359 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4 empty. 2023-09-20 23:02:30,360 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:30,360 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:30,360 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-20 23:02:30,370 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-20 23:02:30,371 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => a3ba9ec7d2bffe0c856cdc5d119d63e4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:02:30,372 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8be77e1c99681e6fc4379cc8e5a13cca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:02:30,387 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing a3ba9ec7d2bffe0c856cdc5d119d63e4, disabling compactions & flushes 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 8be77e1c99681e6fc4379cc8e5a13cca, disabling compactions & flushes 2023-09-20 23:02:30,388 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:30,388 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. after waiting 0 ms 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. after waiting 0 ms 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:30,388 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:30,388 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 8be77e1c99681e6fc4379cc8e5a13cca: 2023-09-20 23:02:30,388 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for a3ba9ec7d2bffe0c856cdc5d119d63e4: 2023-09-20 23:02:30,390 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 23:02:30,391 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695250950391"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250950391"}]},"ts":"1695250950391"} 2023-09-20 23:02:30,392 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695250950391"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250950391"}]},"ts":"1695250950391"} 2023-09-20 23:02:30,397 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 23:02:30,398 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 23:02:30,398 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250950398"}]},"ts":"1695250950398"} 2023-09-20 23:02:30,399 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-20 23:02:30,402 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 23:02:30,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 23:02:30,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 23:02:30,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 23:02:30,403 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 23:02:30,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a3ba9ec7d2bffe0c856cdc5d119d63e4, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8be77e1c99681e6fc4379cc8e5a13cca, ASSIGN}] 2023-09-20 23:02:30,405 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8be77e1c99681e6fc4379cc8e5a13cca, ASSIGN 2023-09-20 23:02:30,405 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a3ba9ec7d2bffe0c856cdc5d119d63e4, ASSIGN 2023-09-20 23:02:30,406 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8be77e1c99681e6fc4379cc8e5a13cca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42935,1695250878960; forceNewPlan=false, retain=false 2023-09-20 23:02:30,406 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a3ba9ec7d2bffe0c856cdc5d119d63e4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35407,1695250878922; forceNewPlan=false, retain=false 2023-09-20 23:02:30,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-20 23:02:30,556 INFO [jenkins-hbase4:45915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 23:02:30,559 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8be77e1c99681e6fc4379cc8e5a13cca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:30,559 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=a3ba9ec7d2bffe0c856cdc5d119d63e4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:30,559 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695250950559"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250950559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250950559"}]},"ts":"1695250950559"} 2023-09-20 23:02:30,559 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695250950559"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250950559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250950559"}]},"ts":"1695250950559"} 2023-09-20 23:02:30,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure a3ba9ec7d2bffe0c856cdc5d119d63e4, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:02:30,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 8be77e1c99681e6fc4379cc8e5a13cca, server=jenkins-hbase4.apache.org,42935,1695250878960}] 2023-09-20 23:02:30,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-20 23:02:30,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:30,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8be77e1c99681e6fc4379cc8e5a13cca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 23:02:30,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. service=AccessControlService 2023-09-20 23:02:30,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:30,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3ba9ec7d2bffe0c856cdc5d119d63e4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 23:02:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. service=AccessControlService 2023-09-20 23:02:30,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:30,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:30,723 INFO [StoreOpener-8be77e1c99681e6fc4379cc8e5a13cca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:30,724 INFO [StoreOpener-a3ba9ec7d2bffe0c856cdc5d119d63e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:30,725 DEBUG [StoreOpener-8be77e1c99681e6fc4379cc8e5a13cca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/cf 2023-09-20 23:02:30,726 DEBUG [StoreOpener-8be77e1c99681e6fc4379cc8e5a13cca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/cf 2023-09-20 23:02:30,726 DEBUG [StoreOpener-a3ba9ec7d2bffe0c856cdc5d119d63e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/cf 2023-09-20 23:02:30,726 DEBUG [StoreOpener-a3ba9ec7d2bffe0c856cdc5d119d63e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/cf 2023-09-20 23:02:30,726 INFO [StoreOpener-8be77e1c99681e6fc4379cc8e5a13cca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8be77e1c99681e6fc4379cc8e5a13cca columnFamilyName cf 2023-09-20 23:02:30,727 INFO [StoreOpener-a3ba9ec7d2bffe0c856cdc5d119d63e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3ba9ec7d2bffe0c856cdc5d119d63e4 columnFamilyName cf 2023-09-20 23:02:30,728 INFO [StoreOpener-8be77e1c99681e6fc4379cc8e5a13cca-1] regionserver.HStore(310): Store=8be77e1c99681e6fc4379cc8e5a13cca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:30,728 INFO [StoreOpener-a3ba9ec7d2bffe0c856cdc5d119d63e4-1] regionserver.HStore(310): Store=a3ba9ec7d2bffe0c856cdc5d119d63e4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:30,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:30,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:30,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:30,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:30,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:30,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:30,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:02:30,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:02:30,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a3ba9ec7d2bffe0c856cdc5d119d63e4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66442216, jitterRate=-0.009933829307556152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:30,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a3ba9ec7d2bffe0c856cdc5d119d63e4: 2023-09-20 23:02:30,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8be77e1c99681e6fc4379cc8e5a13cca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60528002, jitterRate=-0.09806248545646667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:30,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8be77e1c99681e6fc4379cc8e5a13cca: 2023-09-20 23:02:30,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4., pid=60, masterSystemTime=1695250950713 2023-09-20 23:02:30,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca., pid=61, masterSystemTime=1695250950713 2023-09-20 23:02:30,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:30,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:30,741 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=a3ba9ec7d2bffe0c856cdc5d119d63e4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:30,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:30,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:30,741 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695250950741"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250950741"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250950741"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250950741"}]},"ts":"1695250950741"} 2023-09-20 23:02:30,742 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8be77e1c99681e6fc4379cc8e5a13cca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:30,742 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695250950741"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250950741"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250950741"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250950741"}]},"ts":"1695250950741"} 2023-09-20 23:02:30,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-20 23:02:30,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure a3ba9ec7d2bffe0c856cdc5d119d63e4, server=jenkins-hbase4.apache.org,35407,1695250878922 in 182 msec 2023-09-20 23:02:30,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-20 23:02:30,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 8be77e1c99681e6fc4379cc8e5a13cca, server=jenkins-hbase4.apache.org,42935,1695250878960 in 182 msec 2023-09-20 23:02:30,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a3ba9ec7d2bffe0c856cdc5d119d63e4, ASSIGN in 342 msec 2023-09-20 23:02:30,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-20 23:02:30,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8be77e1c99681e6fc4379cc8e5a13cca, ASSIGN in 343 msec 2023-09-20 23:02:30,748 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 23:02:30,749 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250950749"}]},"ts":"1695250950749"} 2023-09-20 23:02:30,750 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-20 23:02:30,753 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 23:02:30,753 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-20 23:02:30,755 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-20 23:02:30,757 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:30,757 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:30,757 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:30,757 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:30,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:30,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:30,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:30,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:30,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 407 msec 2023-09-20 23:02:30,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-20 23:02:30,960 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-20 23:02:30,962 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:30,963 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:30,964 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:02:30,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 23:02:30,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250950976 (current time:1695250950976). 2023-09-20 23:02:30,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:02:30,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x06ffb9be to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:30,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b145a86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:30,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:30,988 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:30,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06ffb9be to 127.0.0.1:53756 2023-09-20 23:02:30,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:30,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x28687b75 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:30,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5321058f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:30,995 DEBUG [hconnection-0x3a88a507-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:30,996 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:30,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:31,002 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:31,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28687b75 to 127.0.0.1:53756 2023-09-20 23:02:31,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:31,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-20 23:02:31,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:02:31,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 23:02:31,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 23:02:31,006 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 23:02:31,007 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695251551007 2023-09-20 23:02:31,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 23:02:31,007 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,008 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:02:31,008 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:02:31,009 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 23:02:31,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 23:02:31,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-20 23:02:31,011 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 23:02:31,012 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695251551012 2023-09-20 23:02:31,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,020 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-20 23:02:31,020 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:31,021 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-20 23:02:31,021 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-20 23:02:31,021 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,022 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,023 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,023 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,023 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,023 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,023 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,023 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,024 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,024 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:02:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-20 23:02:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-20 23:02:31,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 23:02:31,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 23:02:31,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-20 23:02:31,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,025 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 23:02:31,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 23:02:31,025 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:31,026 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 23:02:31,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,026 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 23:02:31,026 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 23:02:31,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,026 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 23:02:31,027 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:31,027 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 23:02:31,027 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 23:02:31,028 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 23:02:31,028 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:31,028 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 23:02:31,028 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 23:02:31,029 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 23:02:31,029 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 23:02:31,031 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,031 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:31,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:31,032 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:31,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:31,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-20 23:02:31,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@389426ac[Count = 1] remaining members to acquire global barrier 2023-09-20 23:02:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:31,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-20 23:02:31,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@389426ac[Count = 0] remaining members to acquire global barrier 2023-09-20 23:02:31,036 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-20 23:02:31,036 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,037 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,037 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,037 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 23:02:31,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,037 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:31,038 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,038 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. started... 2023-09-20 23:02:31,038 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,038 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:02:31,038 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 23:02:31,038 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 23:02:31,039 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8be77e1c99681e6fc4379cc8e5a13cca: 2023-09-20 23:02:31,038 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 23:02:31,039 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:02:31,039 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:31,039 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:31,039 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,039 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:31,039 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:31,039 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. started... 2023-09-20 23:02:31,039 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:02:31,039 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a3ba9ec7d2bffe0c856cdc5d119d63e4: 2023-09-20 23:02:31,040 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,040 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:31,040 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:02:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 23:02:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 23:02:31,059 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. completed. 2023-09-20 23:02:31,059 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:31,059 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. completed. 2023-09-20 23:02:31,059 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:31,059 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:31,059 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,059 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:31,059 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 23:02:31,059 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:02:31,059 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:31,060 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:31,060 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,060 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 23:02:31,060 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:02:31,061 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 23:02:31,061 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:31,061 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,061 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 23:02:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:31,062 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 23:02:31,062 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:31,062 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,062 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 23:02:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:31,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35407,1695250878922': 2023-09-20 23:02:31,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-20 23:02:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:31,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42935,1695250878960': 2023-09-20 23:02:31,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-20 23:02:31,070 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-20 23:02:31,070 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:02:31,070 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:02:31,070 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,070 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:02:31,071 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,071 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,071 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,071 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,071 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,071 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,072 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:31,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,072 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,072 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:31,073 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,075 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,075 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:31,075 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,084 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,084 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,084 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,084 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,085 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:31,084 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,084 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,084 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,086 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,085 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,086 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,085 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:02:31,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,086 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,086 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,086 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,086 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,086 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,086 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,087 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,087 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 23:02:31,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,109 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:31,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-20 23:02:31,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:02:31,110 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:02:31,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-20 23:02:31,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,113 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695250951007Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695250951096 (+89 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695250951096Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695250951096Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695250951100 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695250951107 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695250951112 (+5 ms) 2023-09-20 23:02:31,115 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 23:02:31,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 107 msec 2023-09-20 23:02:31,310 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:31,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-20 23:02:31,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:02:31,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:02:31,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42935] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:02:31,317 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,318 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:31,318 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:02:31,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 23:02:31,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250951328 (current time:1695250951328). 2023-09-20 23:02:31,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:02:31,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x5f7080f0 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:31,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@426e2c7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:31,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:31,339 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:31,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f7080f0 to 127.0.0.1:53756 2023-09-20 23:02:31,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:31,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x2aac074f to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:31,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@718065ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:31,347 DEBUG [hconnection-0x42be8a5c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:31,349 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:31,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:31,354 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:31,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2aac074f to 127.0.0.1:53756 2023-09-20 23:02:31,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:31,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-20 23:02:31,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:02:31,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 23:02:31,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 23:02:31,359 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 23:02:31,360 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695251551360 2023-09-20 23:02:31,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-20 23:02:31,361 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:02:31,361 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:02:31,362 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-20 23:02:31,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 23:02:31,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-20 23:02:31,364 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 23:02:31,364 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695251551364 2023-09-20 23:02:31,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,372 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-20 23:02:31,372 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:31,373 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-20 23:02:31,373 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-20 23:02:31,373 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,373 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,374 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,374 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,374 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,374 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,375 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,375 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,376 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-20 23:02:31,376 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 23:02:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 23:02:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:31,376 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 23:02:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 23:02:31,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 23:02:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 23:02:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-20 23:02:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 23:02:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 23:02:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:31,379 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-20 23:02:31,379 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-20 23:02:31,379 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-20 23:02:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,380 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:31,381 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,381 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,381 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:31,381 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,381 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:31,381 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:31,381 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,381 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:31,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-20 23:02:31,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@716d24d3[Count = 1] remaining members to acquire global barrier 2023-09-20 23:02:31,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:31,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:31,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:31,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:31,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:31,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-20 23:02:31,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@716d24d3[Count = 0] remaining members to acquire global barrier 2023-09-20 23:02:31,384 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-20 23:02:31,384 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,387 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,387 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,387 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,387 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 23:02:31,387 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,387 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 23:02:31,387 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 23:02:31,387 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:02:31,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,387 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:31,387 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:31,387 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:31,387 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-20 23:02:31,387 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. started... 2023-09-20 23:02:31,387 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,387 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:02:31,387 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:31,388 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:31,388 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a3ba9ec7d2bffe0c856cdc5d119d63e4 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-20 23:02:31,388 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:31,388 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. started... 2023-09-20 23:02:31,388 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8be77e1c99681e6fc4379cc8e5a13cca 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-20 23:02:31,388 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 23:02:31,389 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:31,389 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 23:02:31,403 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230920084d4b3b3a5e4650874a92ac117cce49 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230920084d4b3b3a5e4650874a92ac117cce49 2023-09-20 23:02:31,408 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230920d29407a955c244e89d22c1c6197190bc to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230920d29407a955c244e89d22c1c6197190bc 2023-09-20 23:02:31,413 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/.tmp/cf/1b0c710cea5d4ee9a1c7eea4f3623033 2023-09-20 23:02:31,414 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/.tmp/cf/ac5e3f76fcd544a4a117f3a87d11961b 2023-09-20 23:02:31,418 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/.tmp/cf/1b0c710cea5d4ee9a1c7eea4f3623033 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/cf/1b0c710cea5d4ee9a1c7eea4f3623033 2023-09-20 23:02:31,419 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/.tmp/cf/ac5e3f76fcd544a4a117f3a87d11961b as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/cf/ac5e3f76fcd544a4a117f3a87d11961b 2023-09-20 23:02:31,423 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/cf/1b0c710cea5d4ee9a1c7eea4f3623033, entries=3, sequenceid=6, filesize=5.4 K 2023-09-20 23:02:31,423 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for a3ba9ec7d2bffe0c856cdc5d119d63e4 in 35ms, sequenceid=6, compaction requested=false 2023-09-20 23:02:31,424 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-20 23:02:31,424 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/cf/ac5e3f76fcd544a4a117f3a87d11961b, entries=47, sequenceid=6, filesize=13.5 K 2023-09-20 23:02:31,424 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a3ba9ec7d2bffe0c856cdc5d119d63e4: 2023-09-20 23:02:31,424 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,425 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:31,425 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/cf/1b0c710cea5d4ee9a1c7eea4f3623033] hfiles 2023-09-20 23:02:31,425 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/cf/1b0c710cea5d4ee9a1c7eea4f3623033 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,426 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 8be77e1c99681e6fc4379cc8e5a13cca in 37ms, sequenceid=6, compaction requested=false 2023-09-20 23:02:31,427 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8be77e1c99681e6fc4379cc8e5a13cca: 2023-09-20 23:02:31,428 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,428 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:31,428 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/cf/ac5e3f76fcd544a4a117f3a87d11961b] hfiles 2023-09-20 23:02:31,428 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/cf/ac5e3f76fcd544a4a117f3a87d11961b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,434 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. completed. 2023-09-20 23:02:31,434 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:31,435 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:31,435 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:31,435 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,435 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 23:02:31,435 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:02:31,436 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,436 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 23:02:31,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:31,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:31,437 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. completed. 2023-09-20 23:02:31,437 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:31,436 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:31,437 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:31,437 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:31,438 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,437 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 23:02:31,438 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-20 23:02:31,438 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:02:31,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:31,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:31,440 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,440 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-20 23:02:31,440 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:31,440 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-20 23:02:31,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:31,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35407,1695250878922': 2023-09-20 23:02:31,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-20 23:02:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42935,1695250878960': 2023-09-20 23:02:31,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-20 23:02:31,447 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-20 23:02:31,447 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:02:31,447 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:02:31,447 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,448 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:02:31,453 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,453 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,453 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,453 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:31,453 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,453 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,453 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,453 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:31,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,454 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,454 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:31,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:31,456 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,456 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,456 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,458 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,459 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,459 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,459 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,459 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,459 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,459 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,459 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,459 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:31,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,459 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,459 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:31,459 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,460 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:31,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:31,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:31,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,459 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:02:31,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:31,461 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:31,461 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,461 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:31,461 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,461 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,461 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230920d29407a955c244e89d22c1c6197190bc, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230920084d4b3b3a5e4650874a92ac117cce49] mob files 2023-09-20 23:02:31,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230920d29407a955c244e89d22c1c6197190bc 2023-09-20 23:02:31,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230920084d4b3b3a5e4650874a92ac117cce49 2023-09-20 23:02:31,463 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:31,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-20 23:02:31,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:02:31,465 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:02:31,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,485 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-20 23:02:31,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,486 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:31,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695250951360Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695250951468 (+108 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695250951468Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695250951468Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695250951472 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695250951478 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695250951485 (+7 ms) 2023-09-20 23:02:31,488 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-20 23:02:31,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 127 msec 2023-09-20 23:02:31,665 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:31,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-20 23:02:31,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:02:31,694 DEBUG [Listener at jenkins-hbase4.apache.org/44443] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 23:02:31,697 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 23:02:31,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-20 23:02:31,699 DEBUG [Listener at jenkins-hbase4.apache.org/44443] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 23:02:31,702 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 23:02:31,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35755] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-20 23:02:31,702 DEBUG [Listener at jenkins-hbase4.apache.org/44443] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-20 23:02:31,705 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-20 23:02:31,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42935] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-20 23:02:31,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-20 23:02:31,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:31,709 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 23:02:31,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-20 23:02:31,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-20 23:02:31,711 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 23:02:31,714 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:31,714 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:31,714 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39 empty. 2023-09-20 23:02:31,714 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f empty. 2023-09-20 23:02:31,715 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:31,715 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:31,715 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-20 23:02:31,724 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-20 23:02:31,725 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => e9386c8e452bbf39a4bb0c9b7842da39, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:02:31,725 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => b2b20d8863c252e7e4402efee847f37f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing e9386c8e452bbf39a4bb0c9b7842da39, disabling compactions & flushes 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing b2b20d8863c252e7e4402efee847f37f, disabling compactions & flushes 2023-09-20 23:02:31,733 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:31,733 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. after waiting 0 ms 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. after waiting 0 ms 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:31,733 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:31,733 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:31,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for e9386c8e452bbf39a4bb0c9b7842da39: 2023-09-20 23:02:31,734 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for b2b20d8863c252e7e4402efee847f37f: 2023-09-20 23:02:31,736 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 23:02:31,736 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695250951736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250951736"}]},"ts":"1695250951736"} 2023-09-20 23:02:31,736 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695250951736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250951736"}]},"ts":"1695250951736"} 2023-09-20 23:02:31,738 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 23:02:31,739 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 23:02:31,739 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250951739"}]},"ts":"1695250951739"} 2023-09-20 23:02:31,740 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-20 23:02:31,743 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 23:02:31,744 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 23:02:31,744 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 23:02:31,744 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 23:02:31,744 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 23:02:31,744 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9386c8e452bbf39a4bb0c9b7842da39, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b2b20d8863c252e7e4402efee847f37f, ASSIGN}] 2023-09-20 23:02:31,747 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b2b20d8863c252e7e4402efee847f37f, ASSIGN 2023-09-20 23:02:31,747 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9386c8e452bbf39a4bb0c9b7842da39, ASSIGN 2023-09-20 23:02:31,747 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9386c8e452bbf39a4bb0c9b7842da39, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35407,1695250878922; forceNewPlan=false, retain=false 2023-09-20 23:02:31,747 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b2b20d8863c252e7e4402efee847f37f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35755,1695250878873; forceNewPlan=false, retain=false 2023-09-20 23:02:31,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-20 23:02:31,898 INFO [jenkins-hbase4:45915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 23:02:31,900 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e9386c8e452bbf39a4bb0c9b7842da39, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:31,900 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=b2b20d8863c252e7e4402efee847f37f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:31,900 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695250951900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250951900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250951900"}]},"ts":"1695250951900"} 2023-09-20 23:02:31,901 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695250951900"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250951900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250951900"}]},"ts":"1695250951900"} 2023-09-20 23:02:31,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure b2b20d8863c252e7e4402efee847f37f, server=jenkins-hbase4.apache.org,35755,1695250878873}] 2023-09-20 23:02:31,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure e9386c8e452bbf39a4bb0c9b7842da39, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:02:32,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-20 23:02:32,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:32,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:32,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b2b20d8863c252e7e4402efee847f37f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f.', STARTKEY => '2', ENDKEY => ''} 2023-09-20 23:02:32,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9386c8e452bbf39a4bb0c9b7842da39, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39.', STARTKEY => '', ENDKEY => '2'} 2023-09-20 23:02:32,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. service=AccessControlService 2023-09-20 23:02:32,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. service=AccessControlService 2023-09-20 23:02:32,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:32,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:32,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:32,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:32,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:32,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:32,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:32,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:32,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:32,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:32,060 INFO [StoreOpener-e9386c8e452bbf39a4bb0c9b7842da39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:32,060 INFO [StoreOpener-b2b20d8863c252e7e4402efee847f37f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:32,061 DEBUG [StoreOpener-e9386c8e452bbf39a4bb0c9b7842da39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/cf 2023-09-20 23:02:32,061 DEBUG [StoreOpener-b2b20d8863c252e7e4402efee847f37f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/cf 2023-09-20 23:02:32,061 DEBUG [StoreOpener-b2b20d8863c252e7e4402efee847f37f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/cf 2023-09-20 23:02:32,061 DEBUG [StoreOpener-e9386c8e452bbf39a4bb0c9b7842da39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/cf 2023-09-20 23:02:32,062 INFO [StoreOpener-e9386c8e452bbf39a4bb0c9b7842da39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9386c8e452bbf39a4bb0c9b7842da39 columnFamilyName cf 2023-09-20 23:02:32,062 INFO [StoreOpener-b2b20d8863c252e7e4402efee847f37f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2b20d8863c252e7e4402efee847f37f columnFamilyName cf 2023-09-20 23:02:32,062 INFO [StoreOpener-e9386c8e452bbf39a4bb0c9b7842da39-1] regionserver.HStore(310): Store=e9386c8e452bbf39a4bb0c9b7842da39/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:32,062 INFO [StoreOpener-b2b20d8863c252e7e4402efee847f37f-1] regionserver.HStore(310): Store=b2b20d8863c252e7e4402efee847f37f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:32,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:32,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:32,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:32,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:32,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:32,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:32,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:02:32,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:02:32,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e9386c8e452bbf39a4bb0c9b7842da39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68743108, jitterRate=0.02435213327407837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:32,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b2b20d8863c252e7e4402efee847f37f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65885150, jitterRate=-0.01823475956916809}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:32,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e9386c8e452bbf39a4bb0c9b7842da39: 2023-09-20 23:02:32,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b2b20d8863c252e7e4402efee847f37f: 2023-09-20 23:02:32,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f., pid=69, masterSystemTime=1695250952054 2023-09-20 23:02:32,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39., pid=70, masterSystemTime=1695250952054 2023-09-20 23:02:32,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:32,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:32,071 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=b2b20d8863c252e7e4402efee847f37f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:32,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:32,071 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695250952071"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250952071"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250952071"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250952071"}]},"ts":"1695250952071"} 2023-09-20 23:02:32,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:32,072 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e9386c8e452bbf39a4bb0c9b7842da39, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:32,072 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695250952072"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250952072"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250952072"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250952072"}]},"ts":"1695250952072"} 2023-09-20 23:02:32,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-20 23:02:32,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure b2b20d8863c252e7e4402efee847f37f, server=jenkins-hbase4.apache.org,35755,1695250878873 in 171 msec 2023-09-20 23:02:32,075 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-20 23:02:32,075 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure e9386c8e452bbf39a4bb0c9b7842da39, server=jenkins-hbase4.apache.org,35407,1695250878922 in 171 msec 2023-09-20 23:02:32,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b2b20d8863c252e7e4402efee847f37f, ASSIGN in 331 msec 2023-09-20 23:02:32,077 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-20 23:02:32,077 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9386c8e452bbf39a4bb0c9b7842da39, ASSIGN in 331 msec 2023-09-20 23:02:32,077 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 23:02:32,078 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250952078"}]},"ts":"1695250952078"} 2023-09-20 23:02:32,079 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-20 23:02:32,082 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 23:02:32,082 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-20 23:02:32,084 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-20 23:02:32,085 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:32,085 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:32,085 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:32,085 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:32,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:32,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:32,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:32,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:32,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:32,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:32,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:32,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:32,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 379 msec 2023-09-20 23:02:32,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-20 23:02:32,314 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-20 23:02:32,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions e9386c8e452bbf39a4bb0c9b7842da39, b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:32,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e9386c8e452bbf39a4bb0c9b7842da39, b2b20d8863c252e7e4402efee847f37f], force=true 2023-09-20 23:02:32,345 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e9386c8e452bbf39a4bb0c9b7842da39, b2b20d8863c252e7e4402efee847f37f], force=true 2023-09-20 23:02:32,345 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e9386c8e452bbf39a4bb0c9b7842da39, b2b20d8863c252e7e4402efee847f37f], force=true 2023-09-20 23:02:32,345 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e9386c8e452bbf39a4bb0c9b7842da39, b2b20d8863c252e7e4402efee847f37f], force=true 2023-09-20 23:02:32,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-20 23:02:32,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9386c8e452bbf39a4bb0c9b7842da39, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b2b20d8863c252e7e4402efee847f37f, UNASSIGN}] 2023-09-20 23:02:32,368 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b2b20d8863c252e7e4402efee847f37f, UNASSIGN 2023-09-20 23:02:32,368 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9386c8e452bbf39a4bb0c9b7842da39, UNASSIGN 2023-09-20 23:02:32,369 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b2b20d8863c252e7e4402efee847f37f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:32,369 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e9386c8e452bbf39a4bb0c9b7842da39, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:32,369 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695250952369"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250952369"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250952369"}]},"ts":"1695250952369"} 2023-09-20 23:02:32,369 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695250952369"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250952369"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250952369"}]},"ts":"1695250952369"} 2023-09-20 23:02:32,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure b2b20d8863c252e7e4402efee847f37f, server=jenkins-hbase4.apache.org,35755,1695250878873}] 2023-09-20 23:02:32,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure e9386c8e452bbf39a4bb0c9b7842da39, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:02:32,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-20 23:02:32,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:32,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b2b20d8863c252e7e4402efee847f37f, disabling compactions & flushes 2023-09-20 23:02:32,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:32,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:32,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. after waiting 0 ms 2023-09-20 23:02:32,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:32,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b2b20d8863c252e7e4402efee847f37f 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-20 23:02:32,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:32,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e9386c8e452bbf39a4bb0c9b7842da39, disabling compactions & flushes 2023-09-20 23:02:32,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:32,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:32,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. after waiting 0 ms 2023-09-20 23:02:32,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:32,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e9386c8e452bbf39a4bb0c9b7842da39 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-20 23:02:32,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/.tmp/cf/1e341d99822744dd83112f136b42846c 2023-09-20 23:02:32,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/.tmp/cf/c39a1f597a7c47cb8df4c8fa57e9f687 2023-09-20 23:02:32,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/.tmp/cf/c39a1f597a7c47cb8df4c8fa57e9f687 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/cf/c39a1f597a7c47cb8df4c8fa57e9f687 2023-09-20 23:02:32,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/.tmp/cf/1e341d99822744dd83112f136b42846c as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/cf/1e341d99822744dd83112f136b42846c 2023-09-20 23:02:32,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/cf/1e341d99822744dd83112f136b42846c, entries=1, sequenceid=5, filesize=4.7 K 2023-09-20 23:02:32,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/cf/c39a1f597a7c47cb8df4c8fa57e9f687, entries=1, sequenceid=5, filesize=4.7 K 2023-09-20 23:02:32,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e9386c8e452bbf39a4bb0c9b7842da39 in 24ms, sequenceid=5, compaction requested=false 2023-09-20 23:02:32,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-20 23:02:32,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b2b20d8863c252e7e4402efee847f37f in 26ms, sequenceid=5, compaction requested=false 2023-09-20 23:02:32,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-20 23:02:32,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-20 23:02:32,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-20 23:02:32,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:02:32,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:02:32,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39. 2023-09-20 23:02:32,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e9386c8e452bbf39a4bb0c9b7842da39: 2023-09-20 23:02:32,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f. 2023-09-20 23:02:32,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b2b20d8863c252e7e4402efee847f37f: 2023-09-20 23:02:32,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:32,562 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e9386c8e452bbf39a4bb0c9b7842da39, regionState=CLOSED 2023-09-20 23:02:32,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:32,562 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695250952562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250952562"}]},"ts":"1695250952562"} 2023-09-20 23:02:32,562 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b2b20d8863c252e7e4402efee847f37f, regionState=CLOSED 2023-09-20 23:02:32,562 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695250952562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250952562"}]},"ts":"1695250952562"} 2023-09-20 23:02:32,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-20 23:02:32,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure e9386c8e452bbf39a4bb0c9b7842da39, server=jenkins-hbase4.apache.org,35407,1695250878922 in 192 msec 2023-09-20 23:02:32,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-20 23:02:32,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure b2b20d8863c252e7e4402efee847f37f, server=jenkins-hbase4.apache.org,35755,1695250878873 in 194 msec 2023-09-20 23:02:32,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e9386c8e452bbf39a4bb0c9b7842da39, UNASSIGN in 202 msec 2023-09-20 23:02:32,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-20 23:02:32,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b2b20d8863c252e7e4402efee847f37f, UNASSIGN in 199 msec 2023-09-20 23:02:32,608 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-20 23:02:32,609 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951707.e9386c8e452bbf39a4bb0c9b7842da39.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:32,610 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695250951707.b2b20d8863c252e7e4402efee847f37f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:32,610 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:32,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-20 23:02:32,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c3b0344aba4a7e97f6ce168cf293001, ASSIGN}] 2023-09-20 23:02:32,658 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c3b0344aba4a7e97f6ce168cf293001, ASSIGN 2023-09-20 23:02:32,659 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c3b0344aba4a7e97f6ce168cf293001, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,35407,1695250878922; forceNewPlan=false, retain=false 2023-09-20 23:02:32,809 INFO [jenkins-hbase4:45915] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-20 23:02:32,811 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=8c3b0344aba4a7e97f6ce168cf293001, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:32,811 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695250952810"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250952810"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250952810"}]},"ts":"1695250952810"} 2023-09-20 23:02:32,812 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 8c3b0344aba4a7e97f6ce168cf293001, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:02:32,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-20 23:02:32,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. 2023-09-20 23:02:32,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c3b0344aba4a7e97f6ce168cf293001, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.', STARTKEY => '', ENDKEY => ''} 2023-09-20 23:02:32,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. service=AccessControlService 2023-09-20 23:02:32,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:32,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:32,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:32,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:32,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:32,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/.regioninfo 2023-09-20 23:02:32,977 INFO [StoreOpener-8c3b0344aba4a7e97f6ce168cf293001-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:32,978 DEBUG [StoreOpener-8c3b0344aba4a7e97f6ce168cf293001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf 2023-09-20 23:02:32,978 DEBUG [StoreOpener-8c3b0344aba4a7e97f6ce168cf293001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf 2023-09-20 23:02:32,979 INFO [StoreOpener-8c3b0344aba4a7e97f6ce168cf293001-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c3b0344aba4a7e97f6ce168cf293001 columnFamilyName cf 2023-09-20 23:02:33,005 DEBUG [StoreOpener-8c3b0344aba4a7e97f6ce168cf293001-1] regionserver.HStore(539): loaded hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf/1e341d99822744dd83112f136b42846c.e9386c8e452bbf39a4bb0c9b7842da39->hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/cf/1e341d99822744dd83112f136b42846c-top 2023-09-20 23:02:33,010 DEBUG [StoreOpener-8c3b0344aba4a7e97f6ce168cf293001-1] regionserver.HStore(539): loaded hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf/c39a1f597a7c47cb8df4c8fa57e9f687.b2b20d8863c252e7e4402efee847f37f->hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/cf/c39a1f597a7c47cb8df4c8fa57e9f687-top 2023-09-20 23:02:33,010 INFO [StoreOpener-8c3b0344aba4a7e97f6ce168cf293001-1] regionserver.HStore(310): Store=8c3b0344aba4a7e97f6ce168cf293001/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:33,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:33,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:33,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:33,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8c3b0344aba4a7e97f6ce168cf293001; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59830250, jitterRate=-0.10845980048179626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:33,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8c3b0344aba4a7e97f6ce168cf293001: 2023-09-20 23:02:33,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001., pid=77, masterSystemTime=1695250952964 2023-09-20 23:02:33,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.,because compaction is disabled. 2023-09-20 23:02:33,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. 2023-09-20 23:02:33,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. 2023-09-20 23:02:33,018 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=8c3b0344aba4a7e97f6ce168cf293001, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,018 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695250953018"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250953018"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250953018"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250953018"}]},"ts":"1695250953018"} 2023-09-20 23:02:33,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-20 23:02:33,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 8c3b0344aba4a7e97f6ce168cf293001, server=jenkins-hbase4.apache.org,35407,1695250878922 in 208 msec 2023-09-20 23:02:33,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-20 23:02:33,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c3b0344aba4a7e97f6ce168cf293001, ASSIGN in 364 msec 2023-09-20 23:02:33,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e9386c8e452bbf39a4bb0c9b7842da39, b2b20d8863c252e7e4402efee847f37f], force=true in 685 msec 2023-09-20 23:02:33,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-20 23:02:33,452 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-20 23:02:33,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-20 23:02:33,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250953453 (current time:1695250953453). 2023-09-20 23:02:33,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:02:33,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x5f063348 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:33,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64de13f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:33,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:33,465 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:33,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f063348 to 127.0.0.1:53756 2023-09-20 23:02:33,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:33,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x767f4c32 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:33,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@188dadc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:33,474 DEBUG [hconnection-0xc587cb4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:33,477 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:33,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:33,483 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:33,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x767f4c32 to 127.0.0.1:53756 2023-09-20 23:02:33,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:33,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-20 23:02:33,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:02:33,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-20 23:02:33,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-20 23:02:33,488 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-20 23:02:33,489 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695251553489 2023-09-20 23:02:33,489 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-20 23:02:33,493 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:02:33,493 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:02:33,494 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-20 23:02:33,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-20 23:02:33,495 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-09-20 23:02:33,496 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-20 23:02:33,496 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695251553496 2023-09-20 23:02:33,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,509 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-20 23:02:33,509 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:33,511 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-20 23:02:33,511 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-20 23:02:33,511 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,511 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,512 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:33,512 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:33,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:33,512 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:33,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:33,512 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:33,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,513 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,513 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:02:33,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-20 23:02:33,514 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-20 23:02:33,514 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:33,514 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,515 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-20 23:02:33,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,515 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-20 23:02:33,515 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-20 23:02:33,515 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:33,515 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-20 23:02:33,516 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-20 23:02:33,516 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-20 23:02:33,516 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-20 23:02:33,515 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:33,516 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-20 23:02:33,517 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-20 23:02:33,517 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-20 23:02:33,517 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-20 23:02:33,520 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,521 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:33,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:33,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:33,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:33,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:33,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:33,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:33,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-20 23:02:33,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e7ec26[Count = 0] remaining members to acquire global barrier 2023-09-20 23:02:33,523 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-20 23:02:33,523 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,524 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,524 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,524 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,525 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-20 23:02:33,525 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-20 23:02:33,525 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-20 23:02:33,525 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,525 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:02:33,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,525 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:02:33,525 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-20 23:02:33,525 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:02:33,525 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-20 23:02:33,526 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-20 23:02:33,526 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:33,527 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-20 23:02:33,528 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-20 23:02:33,528 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:33,528 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-20 23:02:33,532 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:33,532 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. 2023-09-20 23:02:33,532 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:33,532 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. started... 2023-09-20 23:02:33,533 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8c3b0344aba4a7e97f6ce168cf293001: 2023-09-20 23:02:33,533 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,533 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:33,533 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf/1e341d99822744dd83112f136b42846c.e9386c8e452bbf39a4bb0c9b7842da39->hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/cf/1e341d99822744dd83112f136b42846c-top, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf/c39a1f597a7c47cb8df4c8fa57e9f687.b2b20d8863c252e7e4402efee847f37f->hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/cf/c39a1f597a7c47cb8df4c8fa57e9f687-top] hfiles 2023-09-20 23:02:33,533 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf/1e341d99822744dd83112f136b42846c.e9386c8e452bbf39a4bb0c9b7842da39 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,534 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf/c39a1f597a7c47cb8df4c8fa57e9f687.b2b20d8863c252e7e4402efee847f37f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,540 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. completed. 2023-09-20 23:02:33,541 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. 2023-09-20 23:02:33,541 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:33,541 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:33,541 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,541 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-20 23:02:33,541 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:02:33,545 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-20 23:02:33,545 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,545 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:33,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:33,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:33,545 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-20 23:02:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:33,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:33,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,35407,1695250878922': 2023-09-20 23:02:33,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-20 23:02:33,548 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-20 23:02:33,548 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:02:33,548 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:02:33,548 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,548 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:02:33,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:33,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:33,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:33,550 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:33,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,550 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:33,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,552 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:33,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:33,552 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:33,554 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:33,554 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:33,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:33,555 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:33,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:33,562 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:33,562 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,562 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:33,562 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:33,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:33,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:33,562 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:33,562 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:33,562 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,562 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:33,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,562 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:33,562 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:33,562 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:33,563 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,563 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:33,563 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:33,563 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:33,563 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:33,563 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:33,563 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:33,563 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:33,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,588 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-20 23:02:33,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,589 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695250953489Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695250953562 (+73 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695250953562Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695250953566 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695250953580 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695250953588 (+8 ms) 2023-09-20 23:02:33,591 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-20 23:02:33,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 99 msec 2023-09-20 23:02:33,593 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:33,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-20 23:02:33,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:02:33,594 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250953594 2023-09-20 23:02:33,594 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37461, tgtDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250953594, rawTgtDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250953594, srcFsUri=hdfs://localhost:37461, srcDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:02:33,616 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:02:33,617 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1532523815_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250953594, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250953594/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,617 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611, snapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-20 23:02:33,625 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250953594/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:33,650 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:33,650 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:33,651 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:33,651 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:34,464 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0004_000001 (auth:SIMPLE) 2023-09-20 23:02:34,534 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-4014913800298794987.jar 2023-09-20 23:02:34,534 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:34,535 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:34,601 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-1899605325624623118.jar 2023-09-20 23:02:34,601 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:34,602 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:34,602 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:34,602 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:34,603 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:34,603 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:34,603 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 23:02:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 23:02:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 23:02:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 23:02:34,605 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 23:02:34,605 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 23:02:34,606 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 23:02:34,606 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 23:02:34,606 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 23:02:34,607 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 23:02:34,607 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:34,608 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:34,608 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:34,608 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:34,609 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:34,609 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:34,610 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:34,964 WARN [Listener at jenkins-hbase4.apache.org/44443] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 23:02:34,966 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-20 23:02:34,968 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-20 23:02:35,018 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:02:35,018 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:02:35,421 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0005_000001 (auth:SIMPLE) 2023-09-20 23:02:35,628 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 23:02:39,033 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0005_000001 (auth:SIMPLE) 2023-09-20 23:02:41,250 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0005_000001 (auth:SIMPLE) 2023-09-20 23:02:43,620 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0005_000001 (auth:SIMPLE) 2023-09-20 23:02:45,239 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 23:02:45,242 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 23:02:45,251 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,251 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 23:02:45,251 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 23:02:45,251 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,252 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-20 23:02:45,252 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-20 23:02:45,252 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250953594/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250953594/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,252 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250953594/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-20 23:02:45,252 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250953594/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-20 23:02:45,258 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-20 23:02:45,262 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250965262"}]},"ts":"1695250965262"} 2023-09-20 23:02:45,263 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-20 23:02:45,265 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-20 23:02:45,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c3b0344aba4a7e97f6ce168cf293001, UNASSIGN}] 2023-09-20 23:02:45,267 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c3b0344aba4a7e97f6ce168cf293001, UNASSIGN 2023-09-20 23:02:45,267 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8c3b0344aba4a7e97f6ce168cf293001, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:45,268 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695250965267"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250965267"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250965267"}]},"ts":"1695250965267"} 2023-09-20 23:02:45,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 8c3b0344aba4a7e97f6ce168cf293001, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:02:45,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-20 23:02:45,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:45,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8c3b0344aba4a7e97f6ce168cf293001, disabling compactions & flushes 2023-09-20 23:02:45,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. 2023-09-20 23:02:45,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. 2023-09-20 23:02:45,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. after waiting 0 ms 2023-09-20 23:02:45,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. 2023-09-20 23:02:45,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-20 23:02:45,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:02:45,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001. 2023-09-20 23:02:45,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8c3b0344aba4a7e97f6ce168cf293001: 2023-09-20 23:02:45,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:45,435 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8c3b0344aba4a7e97f6ce168cf293001, regionState=CLOSED 2023-09-20 23:02:45,435 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695250965435"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250965435"}]},"ts":"1695250965435"} 2023-09-20 23:02:45,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-20 23:02:45,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 8c3b0344aba4a7e97f6ce168cf293001, server=jenkins-hbase4.apache.org,35407,1695250878922 in 167 msec 2023-09-20 23:02:45,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-20 23:02:45,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8c3b0344aba4a7e97f6ce168cf293001, UNASSIGN in 172 msec 2023-09-20 23:02:45,439 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250965439"}]},"ts":"1695250965439"} 2023-09-20 23:02:45,440 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-20 23:02:45,442 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-20 23:02:45,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 183 msec 2023-09-20 23:02:45,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-20 23:02:45,565 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-20 23:02:45,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,569 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,570 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,571 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,574 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:45,574 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:45,574 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:45,575 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,575 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,575 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,575 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-20 23:02:45,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-20 23:02:45,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-20 23:02:45,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-20 23:02:45,576 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/recovered.edits] 2023-09-20 23:02:45,576 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/recovered.edits] 2023-09-20 23:02:45,577 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/recovered.edits] 2023-09-20 23:02:45,577 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,577 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,577 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:45,577 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,577 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:45,577 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,577 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:45,577 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:45,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-20 23:02:45,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:45,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:45,579 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:45,579 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:45,582 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/cf/1e341d99822744dd83112f136b42846c to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/cf/1e341d99822744dd83112f136b42846c 2023-09-20 23:02:45,582 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/cf/c39a1f597a7c47cb8df4c8fa57e9f687 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/cf/c39a1f597a7c47cb8df4c8fa57e9f687 2023-09-20 23:02:45,582 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf/1e341d99822744dd83112f136b42846c.e9386c8e452bbf39a4bb0c9b7842da39 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf/1e341d99822744dd83112f136b42846c.e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:45,584 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf/c39a1f597a7c47cb8df4c8fa57e9f687.b2b20d8863c252e7e4402efee847f37f to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/cf/c39a1f597a7c47cb8df4c8fa57e9f687.b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:45,585 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/recovered.edits/8.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39/recovered.edits/8.seqid 2023-09-20 23:02:45,585 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/recovered.edits/8.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f/recovered.edits/8.seqid 2023-09-20 23:02:45,586 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e9386c8e452bbf39a4bb0c9b7842da39 2023-09-20 23:02:45,586 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b2b20d8863c252e7e4402efee847f37f 2023-09-20 23:02:45,587 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/recovered.edits/12.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001/recovered.edits/12.seqid 2023-09-20 23:02:45,587 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8c3b0344aba4a7e97f6ce168cf293001 2023-09-20 23:02:45,587 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-20 23:02:45,589 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,591 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-20 23:02:45,593 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-20 23:02:45,594 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,594 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-20 23:02:45,594 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250965594"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:45,597 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-20 23:02:45,597 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8c3b0344aba4a7e97f6ce168cf293001, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695250951708.8c3b0344aba4a7e97f6ce168cf293001.', STARTKEY => '', ENDKEY => ''}] 2023-09-20 23:02:45,597 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-20 23:02:45,597 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695250965597"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:45,598 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-20 23:02:45,600 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:45,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 34 msec 2023-09-20 23:02:45,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-20 23:02:45,679 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-20 23:02:45,680 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-20 23:02:45,684 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250965684"}]},"ts":"1695250965684"} 2023-09-20 23:02:45,686 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-20 23:02:45,687 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-20 23:02:45,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a3ba9ec7d2bffe0c856cdc5d119d63e4, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8be77e1c99681e6fc4379cc8e5a13cca, UNASSIGN}] 2023-09-20 23:02:45,690 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a3ba9ec7d2bffe0c856cdc5d119d63e4, UNASSIGN 2023-09-20 23:02:45,690 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8be77e1c99681e6fc4379cc8e5a13cca, UNASSIGN 2023-09-20 23:02:45,690 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=a3ba9ec7d2bffe0c856cdc5d119d63e4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:45,690 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=8be77e1c99681e6fc4379cc8e5a13cca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:45,691 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695250965690"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250965690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250965690"}]},"ts":"1695250965690"} 2023-09-20 23:02:45,691 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695250965690"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250965690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250965690"}]},"ts":"1695250965690"} 2023-09-20 23:02:45,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 8be77e1c99681e6fc4379cc8e5a13cca, server=jenkins-hbase4.apache.org,42935,1695250878960}] 2023-09-20 23:02:45,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure a3ba9ec7d2bffe0c856cdc5d119d63e4, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:02:45,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-20 23:02:45,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:45,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8be77e1c99681e6fc4379cc8e5a13cca, disabling compactions & flushes 2023-09-20 23:02:45,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:45,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:45,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. after waiting 0 ms 2023-09-20 23:02:45,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:45,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:45,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a3ba9ec7d2bffe0c856cdc5d119d63e4, disabling compactions & flushes 2023-09-20 23:02:45,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:45,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:45,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. after waiting 0 ms 2023-09-20 23:02:45,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:45,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:02:45,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:02:45,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:02:45,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:02:45,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca. 2023-09-20 23:02:45,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8be77e1c99681e6fc4379cc8e5a13cca: 2023-09-20 23:02:45,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4. 2023-09-20 23:02:45,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a3ba9ec7d2bffe0c856cdc5d119d63e4: 2023-09-20 23:02:45,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:45,859 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=8be77e1c99681e6fc4379cc8e5a13cca, regionState=CLOSED 2023-09-20 23:02:45,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:45,859 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695250965859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250965859"}]},"ts":"1695250965859"} 2023-09-20 23:02:45,859 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=a3ba9ec7d2bffe0c856cdc5d119d63e4, regionState=CLOSED 2023-09-20 23:02:45,859 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695250965859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250965859"}]},"ts":"1695250965859"} 2023-09-20 23:02:45,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-20 23:02:45,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 8be77e1c99681e6fc4379cc8e5a13cca, server=jenkins-hbase4.apache.org,42935,1695250878960 in 168 msec 2023-09-20 23:02:45,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-20 23:02:45,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure a3ba9ec7d2bffe0c856cdc5d119d63e4, server=jenkins-hbase4.apache.org,35407,1695250878922 in 169 msec 2023-09-20 23:02:45,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8be77e1c99681e6fc4379cc8e5a13cca, UNASSIGN in 174 msec 2023-09-20 23:02:45,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-20 23:02:45,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a3ba9ec7d2bffe0c856cdc5d119d63e4, UNASSIGN in 175 msec 2023-09-20 23:02:45,865 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250965864"}]},"ts":"1695250965864"} 2023-09-20 23:02:45,866 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-20 23:02:45,868 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-20 23:02:45,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 189 msec 2023-09-20 23:02:45,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-20 23:02:45,986 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-20 23:02:45,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,990 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,990 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,992 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,994 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,995 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-20 23:02:45,995 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:45,995 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:45,995 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-20 23:02:45,995 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-20 23:02:45,995 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-20 23:02:45,996 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,996 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,996 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,996 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:45,996 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:45,996 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:45,996 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:45,996 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:45,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-20 23:02:45,997 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/recovered.edits] 2023-09-20 23:02:45,997 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/recovered.edits] 2023-09-20 23:02:46,001 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/cf/1b0c710cea5d4ee9a1c7eea4f3623033 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/cf/1b0c710cea5d4ee9a1c7eea4f3623033 2023-09-20 23:02:46,001 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/cf/ac5e3f76fcd544a4a117f3a87d11961b to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/cf/ac5e3f76fcd544a4a117f3a87d11961b 2023-09-20 23:02:46,004 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4/recovered.edits/9.seqid 2023-09-20 23:02:46,004 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca/recovered.edits/9.seqid 2023-09-20 23:02:46,005 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a3ba9ec7d2bffe0c856cdc5d119d63e4 2023-09-20 23:02:46,005 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8be77e1c99681e6fc4379cc8e5a13cca 2023-09-20 23:02:46,005 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-20 23:02:46,006 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-20 23:02:46,006 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-20 23:02:46,009 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230920d29407a955c244e89d22c1c6197190bc to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230920d29407a955c244e89d22c1c6197190bc 2023-09-20 23:02:46,010 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230920084d4b3b3a5e4650874a92ac117cce49 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230920084d4b3b3a5e4650874a92ac117cce49 2023-09-20 23:02:46,010 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-20 23:02:46,012 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:46,014 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-20 23:02:46,016 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-20 23:02:46,017 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:46,017 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-20 23:02:46,017 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250966017"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:46,017 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250966017"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:46,018 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 23:02:46,018 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a3ba9ec7d2bffe0c856cdc5d119d63e4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695250950352.a3ba9ec7d2bffe0c856cdc5d119d63e4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8be77e1c99681e6fc4379cc8e5a13cca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695250950352.8be77e1c99681e6fc4379cc8e5a13cca.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 23:02:46,018 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-20 23:02:46,018 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695250966018"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:46,020 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-20 23:02:46,022 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:46,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-20 23:02:46,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-20 23:02:46,098 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-20 23:02:46,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-20 23:02:46,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:46,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-20 23:02:46,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-20 23:02:46,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-20 23:02:46,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-20 23:02:46,137 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 749) Potentially hanging thread: hconnection-0x3f712515-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:57812 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4072 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:34048 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:47824 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-657493092_1 at /127.0.0.1:34042 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1511478988) connection to jenkins-hbase4.apache.org/172.31.14.131:38765 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-657493092_1 at /127.0.0.1:57796 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=115 (was 121), ProcessCount=168 (was 168), AvailableMemoryMB=3021 (was 2996) - AvailableMemoryMB LEAK? - 2023-09-20 23:02:46,137 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-20 23:02:46,156 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=115, ProcessCount=168, AvailableMemoryMB=3020 2023-09-20 23:02:46,156 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-20 23:02:46,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 23:02:46,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 23:02:46,160 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 23:02:46,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-20 23:02:46,160 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 23:02:46,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-20 23:02:46,163 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:46,163 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0 2023-09-20 23:02:46,163 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0 empty. 2023-09-20 23:02:46,163 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6 empty. 2023-09-20 23:02:46,164 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0 2023-09-20 23:02:46,164 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:46,164 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-20 23:02:46,172 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-20 23:02:46,173 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => cd72744d887503d56189c5555c0a4eb6, NAME => 'testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:02:46,174 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5495126eafef6885729fdd997998fea0, NAME => 'testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5495126eafef6885729fdd997998fea0, disabling compactions & flushes 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:46,190 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing cd72744d887503d56189c5555c0a4eb6, disabling compactions & flushes 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:46,190 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. after waiting 0 ms 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. after waiting 0 ms 2023-09-20 23:02:46,190 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5495126eafef6885729fdd997998fea0: 2023-09-20 23:02:46,190 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:46,190 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for cd72744d887503d56189c5555c0a4eb6: 2023-09-20 23:02:46,192 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 23:02:46,193 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695250966193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250966193"}]},"ts":"1695250966193"} 2023-09-20 23:02:46,193 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695250966193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250966193"}]},"ts":"1695250966193"} 2023-09-20 23:02:46,195 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 23:02:46,196 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 23:02:46,196 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250966196"}]},"ts":"1695250966196"} 2023-09-20 23:02:46,197 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-20 23:02:46,200 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 23:02:46,201 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 23:02:46,201 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 23:02:46,201 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 23:02:46,201 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 23:02:46,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cd72744d887503d56189c5555c0a4eb6, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5495126eafef6885729fdd997998fea0, ASSIGN}] 2023-09-20 23:02:46,204 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5495126eafef6885729fdd997998fea0, ASSIGN 2023-09-20 23:02:46,204 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cd72744d887503d56189c5555c0a4eb6, ASSIGN 2023-09-20 23:02:46,204 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5495126eafef6885729fdd997998fea0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35755,1695250878873; forceNewPlan=false, retain=false 2023-09-20 23:02:46,204 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cd72744d887503d56189c5555c0a4eb6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42935,1695250878960; forceNewPlan=false, retain=false 2023-09-20 23:02:46,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-20 23:02:46,355 INFO [jenkins-hbase4:45915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 23:02:46,357 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=5495126eafef6885729fdd997998fea0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,357 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=cd72744d887503d56189c5555c0a4eb6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,358 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695250966357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250966357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250966357"}]},"ts":"1695250966357"} 2023-09-20 23:02:46,358 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695250966357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250966357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250966357"}]},"ts":"1695250966357"} 2023-09-20 23:02:46,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 5495126eafef6885729fdd997998fea0, server=jenkins-hbase4.apache.org,35755,1695250878873}] 2023-09-20 23:02:46,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure cd72744d887503d56189c5555c0a4eb6, server=jenkins-hbase4.apache.org,42935,1695250878960}] 2023-09-20 23:02:46,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-20 23:02:46,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:46,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5495126eafef6885729fdd997998fea0, NAME => 'testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 23:02:46,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. service=AccessControlService 2023-09-20 23:02:46,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:46,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5495126eafef6885729fdd997998fea0 2023-09-20 23:02:46,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:46,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5495126eafef6885729fdd997998fea0 2023-09-20 23:02:46,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5495126eafef6885729fdd997998fea0 2023-09-20 23:02:46,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:46,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cd72744d887503d56189c5555c0a4eb6, NAME => 'testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 23:02:46,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. service=AccessControlService 2023-09-20 23:02:46,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:46,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:46,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:46,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:46,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:46,526 INFO [StoreOpener-5495126eafef6885729fdd997998fea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5495126eafef6885729fdd997998fea0 2023-09-20 23:02:46,527 INFO [StoreOpener-cd72744d887503d56189c5555c0a4eb6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:46,528 DEBUG [StoreOpener-5495126eafef6885729fdd997998fea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/cf 2023-09-20 23:02:46,528 DEBUG [StoreOpener-5495126eafef6885729fdd997998fea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/cf 2023-09-20 23:02:46,528 DEBUG [StoreOpener-cd72744d887503d56189c5555c0a4eb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/cf 2023-09-20 23:02:46,528 INFO [StoreOpener-5495126eafef6885729fdd997998fea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5495126eafef6885729fdd997998fea0 columnFamilyName cf 2023-09-20 23:02:46,529 DEBUG [StoreOpener-cd72744d887503d56189c5555c0a4eb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/cf 2023-09-20 23:02:46,529 INFO [StoreOpener-cd72744d887503d56189c5555c0a4eb6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd72744d887503d56189c5555c0a4eb6 columnFamilyName cf 2023-09-20 23:02:46,530 INFO [StoreOpener-5495126eafef6885729fdd997998fea0-1] regionserver.HStore(310): Store=5495126eafef6885729fdd997998fea0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:46,530 INFO [StoreOpener-cd72744d887503d56189c5555c0a4eb6-1] regionserver.HStore(310): Store=cd72744d887503d56189c5555c0a4eb6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:46,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0 2023-09-20 23:02:46,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:46,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0 2023-09-20 23:02:46,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:46,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:46,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5495126eafef6885729fdd997998fea0 2023-09-20 23:02:46,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:02:46,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:02:46,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cd72744d887503d56189c5555c0a4eb6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70347700, jitterRate=0.04826241731643677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:46,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5495126eafef6885729fdd997998fea0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69998839, jitterRate=0.04306398332118988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:46,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cd72744d887503d56189c5555c0a4eb6: 2023-09-20 23:02:46,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5495126eafef6885729fdd997998fea0: 2023-09-20 23:02:46,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6., pid=94, masterSystemTime=1695250966515 2023-09-20 23:02:46,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0., pid=93, masterSystemTime=1695250966511 2023-09-20 23:02:46,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:46,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:46,540 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=cd72744d887503d56189c5555c0a4eb6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:46,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:46,540 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695250966540"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250966540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250966540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250966540"}]},"ts":"1695250966540"} 2023-09-20 23:02:46,540 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=5495126eafef6885729fdd997998fea0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,540 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695250966540"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250966540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250966540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250966540"}]},"ts":"1695250966540"} 2023-09-20 23:02:46,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-20 23:02:46,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure cd72744d887503d56189c5555c0a4eb6, server=jenkins-hbase4.apache.org,42935,1695250878960 in 181 msec 2023-09-20 23:02:46,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-20 23:02:46,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 5495126eafef6885729fdd997998fea0, server=jenkins-hbase4.apache.org,35755,1695250878873 in 183 msec 2023-09-20 23:02:46,545 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cd72744d887503d56189c5555c0a4eb6, ASSIGN in 341 msec 2023-09-20 23:02:46,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-20 23:02:46,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5495126eafef6885729fdd997998fea0, ASSIGN in 343 msec 2023-09-20 23:02:46,547 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 23:02:46,547 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250966547"}]},"ts":"1695250966547"} 2023-09-20 23:02:46,548 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-20 23:02:46,550 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 23:02:46,551 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-20 23:02:46,552 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 23:02:46,559 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:46,559 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:46,559 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:46,559 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:46,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:46,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:46,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:46,561 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:46,562 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 403 msec 2023-09-20 23:02:46,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-20 23:02:46,764 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-20 23:02:46,767 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-20 23:02:46,767 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:46,769 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:02:46,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:02:46,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250966780 (current time:1695250966780). 2023-09-20 23:02:46,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:02:46,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x6b036b3e to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:46,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34803c32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:46,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:46,791 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:46,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b036b3e to 127.0.0.1:53756 2023-09-20 23:02:46,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:46,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x14bb9897 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:46,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64115ba5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:46,799 DEBUG [hconnection-0x51458ab9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:46,801 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:46,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:46,807 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:46,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14bb9897 to 127.0.0.1:53756 2023-09-20 23:02:46,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:46,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 23:02:46,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:02:46,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:02:46,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:02:46,811 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:02:46,812 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695251566812 2023-09-20 23:02:46,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:02:46,812 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-20 23:02:46,813 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:02:46,813 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:02:46,814 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:02:46,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 23:02:46,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-20 23:02:46,818 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 23:02:46,818 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695251566818 2023-09-20 23:02:46,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,828 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-20 23:02:46,828 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:46,829 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-20 23:02:46,829 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-20 23:02:46,829 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,829 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,835 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:46,835 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:46,835 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:46,835 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:46,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:46,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:46,835 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:46,836 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:46,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,836 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,836 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:02:46,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 23:02:46,837 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,837 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 23:02:46,837 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 23:02:46,837 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:46,837 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:46,839 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 23:02:46,840 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 23:02:46,837 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:46,840 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 23:02:46,840 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 23:02:46,841 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 23:02:46,841 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 23:02:46,841 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 23:02:46,841 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 23:02:46,841 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 23:02:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,844 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,844 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,844 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:46,849 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:46,850 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:46,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-20 23:02:46,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9f5db1[Count = 1] remaining members to acquire global barrier 2023-09-20 23:02:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:46,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-20 23:02:46,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9f5db1[Count = 0] remaining members to acquire global barrier 2023-09-20 23:02:46,855 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-20 23:02:46,855 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,858 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,858 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,858 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:02:46,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,858 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:02:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:02:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 23:02:46,858 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:46,858 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,858 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:02:46,858 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. started... 2023-09-20 23:02:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:02:46,858 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:46,859 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. started... 2023-09-20 23:02:46,859 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cd72744d887503d56189c5555c0a4eb6: 2023-09-20 23:02:46,859 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:46,860 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5495126eafef6885729fdd997998fea0: 2023-09-20 23:02:46,860 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,860 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:46,860 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:02:46,860 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,860 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:46,860 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:02:46,861 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 23:02:46,861 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:46,861 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 23:02:46,871 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. completed. 2023-09-20 23:02:46,871 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:46,871 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:46,871 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:46,871 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. completed. 2023-09-20 23:02:46,871 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:46,871 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,871 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:46,871 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:46,871 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,871 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 23:02:46,871 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 23:02:46,871 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:02:46,871 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:02:46,873 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 23:02:46,873 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,873 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:46,874 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:46,873 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 23:02:46,874 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 23:02:46,874 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:46,874 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 23:02:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:46,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35755,1695250878873': 2023-09-20 23:02:46,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-20 23:02:46,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:46,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42935,1695250878960': 2023-09-20 23:02:46,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-20 23:02:46,882 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-20 23:02:46,882 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:02:46,882 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:02:46,882 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,882 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:02:46,884 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,884 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,884 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,884 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:46,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,884 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:46,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:46,884 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:46,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,885 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,885 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:46,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:46,885 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,886 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:46,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,887 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:46,888 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,888 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,891 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,891 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,891 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:46,891 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,891 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:46,891 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:46,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,891 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-20 23:02:46,891 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:46,891 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:46,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:46,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:02:46,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:46,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:46,892 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:46,892 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,892 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:46,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:46,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:46,893 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:46,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:46,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:46,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:46,893 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,893 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:46,893 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:46,893 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 23:02:46,893 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:46,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:46,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:46,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:46,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,913 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:46,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 23:02:46,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:02:46,914 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:02:46,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-20 23:02:46,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,920 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:46,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695250966812Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695250966904 (+92 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695250966904Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695250966904Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695250966907 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695250966914 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695250966919 (+5 ms) 2023-09-20 23:02:46,923 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 23:02:46,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 110 msec 2023-09-20 23:02:47,114 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:47,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 23:02:47,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:02:47,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42935] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:02:47,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35755] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:02:47,121 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-20 23:02:47,121 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:47,122 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:02:47,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:02:47,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250967130 (current time:1695250967130). 2023-09-20 23:02:47,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:02:47,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x0742e483 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:47,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7aafb690, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:47,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:47,140 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:47,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0742e483 to 127.0.0.1:53756 2023-09-20 23:02:47,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:47,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x0836fd9a to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:47,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@184076e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:47,150 DEBUG [hconnection-0x1fdc484d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:47,151 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:47,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:47,155 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:47,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0836fd9a to 127.0.0.1:53756 2023-09-20 23:02:47,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:47,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-20 23:02:47,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:02:47,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:02:47,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:02:47,160 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:02:47,160 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695251567160 2023-09-20 23:02:47,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-20 23:02:47,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-20 23:02:47,161 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:02:47,161 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:02:47,162 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-20 23:02:47,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 23:02:47,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-20 23:02:47,164 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 23:02:47,165 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695251567165 2023-09-20 23:02:47,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,172 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-20 23:02:47,172 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:47,173 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-20 23:02:47,173 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-20 23:02:47,173 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,173 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,174 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:47,174 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:47,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:47,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:47,174 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,174 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:47,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,175 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,175 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,175 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,175 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:02:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-20 23:02:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,176 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 23:02:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-20 23:02:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,176 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 23:02:47,176 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 23:02:47,176 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:47,177 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 23:02:47,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,177 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 23:02:47,177 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:47,177 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 23:02:47,178 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 23:02:47,178 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 23:02:47,178 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 23:02:47,178 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 23:02:47,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-20 23:02:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-20 23:02:47,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,179 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-20 23:02:47,179 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:47,182 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-20 23:02:47,182 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-20 23:02:47,182 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-20 23:02:47,182 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,184 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,184 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:47,184 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,184 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:47,185 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:47,186 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,186 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:47,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-20 23:02:47,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46a7b1a8[Count = 1] remaining members to acquire global barrier 2023-09-20 23:02:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:47,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-20 23:02:47,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46a7b1a8[Count = 0] remaining members to acquire global barrier 2023-09-20 23:02:47,189 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-20 23:02:47,189 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,192 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,192 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,192 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,192 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,192 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:02:47,192 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:02:47,192 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-20 23:02:47,192 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 23:02:47,192 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:02:47,192 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:47,192 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:47,192 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,193 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:02:47,193 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:47,192 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:47,193 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. started... 2023-09-20 23:02:47,192 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:47,193 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:47,193 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. started... 2023-09-20 23:02:47,193 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5495126eafef6885729fdd997998fea0 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-20 23:02:47,193 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cd72744d887503d56189c5555c0a4eb6 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-20 23:02:47,195 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 23:02:47,195 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:47,195 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 23:02:47,209 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309205b18ea040c5f406da43937d19611c59f to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309205b18ea040c5f406da43937d19611c59f 2023-09-20 23:02:47,211 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309203881dcac7aa84cd49f3184753240709e to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309203881dcac7aa84cd49f3184753240709e 2023-09-20 23:02:47,219 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/.tmp/cf/9925974ab1364b1f8bbb9a3f42e2348c 2023-09-20 23:02:47,220 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/.tmp/cf/3f8c63da35874121a8d0b5564368eb06 2023-09-20 23:02:47,224 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/.tmp/cf/9925974ab1364b1f8bbb9a3f42e2348c as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/cf/9925974ab1364b1f8bbb9a3f42e2348c 2023-09-20 23:02:47,225 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/.tmp/cf/3f8c63da35874121a8d0b5564368eb06 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/cf/3f8c63da35874121a8d0b5564368eb06 2023-09-20 23:02:47,229 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/cf/9925974ab1364b1f8bbb9a3f42e2348c, entries=3, sequenceid=6, filesize=5.4 K 2023-09-20 23:02:47,230 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for cd72744d887503d56189c5555c0a4eb6 in 37ms, sequenceid=6, compaction requested=false 2023-09-20 23:02:47,230 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-20 23:02:47,230 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cd72744d887503d56189c5555c0a4eb6: 2023-09-20 23:02:47,230 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,232 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:47,232 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/cf/9925974ab1364b1f8bbb9a3f42e2348c] hfiles 2023-09-20 23:02:47,232 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/cf/9925974ab1364b1f8bbb9a3f42e2348c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,232 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/cf/3f8c63da35874121a8d0b5564368eb06, entries=47, sequenceid=6, filesize=13.1 K 2023-09-20 23:02:47,233 INFO [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 5495126eafef6885729fdd997998fea0 in 40ms, sequenceid=6, compaction requested=false 2023-09-20 23:02:47,234 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5495126eafef6885729fdd997998fea0: 2023-09-20 23:02:47,234 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,235 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:47,235 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/cf/3f8c63da35874121a8d0b5564368eb06] hfiles 2023-09-20 23:02:47,235 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/cf/3f8c63da35874121a8d0b5564368eb06 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,246 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. completed. 2023-09-20 23:02:47,246 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:47,246 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:47,246 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:47,246 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,246 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 23:02:47,246 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:02:47,248 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,248 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 23:02:47,248 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. completed. 2023-09-20 23:02:47,248 DEBUG [rs(jenkins-hbase4.apache.org,35755,1695250878873)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,248 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:47,248 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:47,248 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:47,248 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:47,250 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-20 23:02:47,249 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 23:02:47,250 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:02:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:47,251 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,251 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-20 23:02:47,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,251 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:47,251 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-20 23:02:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42935,1695250878960': 2023-09-20 23:02:47,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-20 23:02:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:47,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:47,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:47,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35755,1695250878873': 2023-09-20 23:02:47,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-20 23:02:47,258 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-20 23:02:47,258 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:02:47,258 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:02:47,258 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,258 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:02:47,259 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,259 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,260 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,260 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:47,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:47,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:47,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,260 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,260 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:47,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,260 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:47,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:47,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:47,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:47,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:47,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:47,260 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,261 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:47,261 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,262 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:47,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 23:02:47,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:02:47,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:47,263 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,263 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:02:47,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,263 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,263 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,267 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,267 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,267 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,267 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:47,267 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:47,267 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:47,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:47,267 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:47,267 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:47,267 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:47,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:47,267 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:47,269 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:47,267 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:47,269 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-20 23:02:47,267 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:47,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:47,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:47,269 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:47,269 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:02:47,269 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:47,269 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:47,269 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,269 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:47,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:47,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309203881dcac7aa84cd49f3184753240709e, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309205b18ea040c5f406da43937d19611c59f] mob files 2023-09-20 23:02:47,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309203881dcac7aa84cd49f3184753240709e 2023-09-20 23:02:47,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309205b18ea040c5f406da43937d19611c59f 2023-09-20 23:02:47,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,291 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-20 23:02:47,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,291 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695250967160Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695250967276 (+116 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695250967276Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695250967276Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695250967279 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695250967285 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695250967291 (+6 ms) 2023-09-20 23:02:47,294 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-20 23:02:47,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 133 msec 2023-09-20 23:02:47,463 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:47,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-20 23:02:47,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:02:47,464 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250967464 2023-09-20 23:02:47,465 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37461, tgtDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250967464, rawTgtDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250967464, srcFsUri=hdfs://localhost:37461, srcDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:02:47,487 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:02:47,487 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1220481705_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250967464, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250967464/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,487 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611, snapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-20 23:02:47,492 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250967464/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:47,514 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:47,515 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:47,516 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:47,516 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:48,390 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-5515102646460800204.jar 2023-09-20 23:02:48,390 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:48,391 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:48,457 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-6253076247711777322.jar 2023-09-20 23:02:48,457 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:48,457 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:48,458 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:48,458 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:48,458 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:48,459 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:48,459 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 23:02:48,459 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 23:02:48,460 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 23:02:48,460 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 23:02:48,460 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 23:02:48,461 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 23:02:48,461 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 23:02:48,461 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 23:02:48,462 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 23:02:48,462 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 23:02:48,463 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:48,463 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:48,464 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:48,464 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:48,464 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:48,464 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:48,465 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:48,797 WARN [Listener at jenkins-hbase4.apache.org/44443] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 23:02:48,799 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-20 23:02:49,785 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:02:49,785 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:02:49,788 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0005_000001 (auth:SIMPLE) 2023-09-20 23:02:50,486 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0006_000001 (auth:SIMPLE) 2023-09-20 23:02:51,029 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 23:02:54,100 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0006_000001 (auth:SIMPLE) 2023-09-20 23:02:57,137 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 23:02:57,138 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 23:02:57,143 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:57,143 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 23:02:57,144 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 23:02:57,144 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:57,144 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-20 23:02:57,144 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-20 23:02:57,144 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250967464/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250967464/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:57,145 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250967464/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-20 23:02:57,145 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250967464/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-20 23:02:57,149 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-20 23:02:57,153 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250977153"}]},"ts":"1695250977153"} 2023-09-20 23:02:57,154 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-20 23:02:57,156 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-20 23:02:57,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cd72744d887503d56189c5555c0a4eb6, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5495126eafef6885729fdd997998fea0, UNASSIGN}] 2023-09-20 23:02:57,160 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cd72744d887503d56189c5555c0a4eb6, UNASSIGN 2023-09-20 23:02:57,161 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5495126eafef6885729fdd997998fea0, UNASSIGN 2023-09-20 23:02:57,161 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=5495126eafef6885729fdd997998fea0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:57,161 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=cd72744d887503d56189c5555c0a4eb6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:57,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695250977161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250977161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250977161"}]},"ts":"1695250977161"} 2023-09-20 23:02:57,161 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695250977161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250977161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250977161"}]},"ts":"1695250977161"} 2023-09-20 23:02:57,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 5495126eafef6885729fdd997998fea0, server=jenkins-hbase4.apache.org,35755,1695250878873}] 2023-09-20 23:02:57,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure cd72744d887503d56189c5555c0a4eb6, server=jenkins-hbase4.apache.org,42935,1695250878960}] 2023-09-20 23:02:57,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-20 23:02:57,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:57,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5495126eafef6885729fdd997998fea0 2023-09-20 23:02:57,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cd72744d887503d56189c5555c0a4eb6, disabling compactions & flushes 2023-09-20 23:02:57,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5495126eafef6885729fdd997998fea0, disabling compactions & flushes 2023-09-20 23:02:57,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:57,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:57,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:57,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:57,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. after waiting 0 ms 2023-09-20 23:02:57,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:57,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. after waiting 0 ms 2023-09-20 23:02:57,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:57,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:02:57,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:02:57,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:02:57,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:02:57,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6. 2023-09-20 23:02:57,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cd72744d887503d56189c5555c0a4eb6: 2023-09-20 23:02:57,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0. 2023-09-20 23:02:57,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5495126eafef6885729fdd997998fea0: 2023-09-20 23:02:57,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5495126eafef6885729fdd997998fea0 2023-09-20 23:02:57,327 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=5495126eafef6885729fdd997998fea0, regionState=CLOSED 2023-09-20 23:02:57,327 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695250977327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250977327"}]},"ts":"1695250977327"} 2023-09-20 23:02:57,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:57,328 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=cd72744d887503d56189c5555c0a4eb6, regionState=CLOSED 2023-09-20 23:02:57,328 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695250977328"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250977328"}]},"ts":"1695250977328"} 2023-09-20 23:02:57,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-20 23:02:57,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 5495126eafef6885729fdd997998fea0, server=jenkins-hbase4.apache.org,35755,1695250878873 in 167 msec 2023-09-20 23:02:57,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-20 23:02:57,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure cd72744d887503d56189c5555c0a4eb6, server=jenkins-hbase4.apache.org,42935,1695250878960 in 166 msec 2023-09-20 23:02:57,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5495126eafef6885729fdd997998fea0, UNASSIGN in 174 msec 2023-09-20 23:02:57,332 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-20 23:02:57,332 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cd72744d887503d56189c5555c0a4eb6, UNASSIGN in 175 msec 2023-09-20 23:02:57,333 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250977333"}]},"ts":"1695250977333"} 2023-09-20 23:02:57,334 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-20 23:02:57,335 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-20 23:02:57,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 187 msec 2023-09-20 23:02:57,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-20 23:02:57,455 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-20 23:02:57,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,458 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,460 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,463 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0 2023-09-20 23:02:57,463 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:57,464 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/recovered.edits] 2023-09-20 23:02:57,465 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/recovered.edits] 2023-09-20 23:02:57,468 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/cf/3f8c63da35874121a8d0b5564368eb06 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/cf/3f8c63da35874121a8d0b5564368eb06 2023-09-20 23:02:57,468 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/cf/9925974ab1364b1f8bbb9a3f42e2348c to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/cf/9925974ab1364b1f8bbb9a3f42e2348c 2023-09-20 23:02:57,468 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,468 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,468 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,469 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,469 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-20 23:02:57,469 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-20 23:02:57,469 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-20 23:02:57,469 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-20 23:02:57,471 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0/recovered.edits/9.seqid 2023-09-20 23:02:57,472 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6/recovered.edits/9.seqid 2023-09-20 23:02:57,472 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/5495126eafef6885729fdd997998fea0 2023-09-20 23:02:57,472 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testEmptyExportFileSystemState/cd72744d887503d56189c5555c0a4eb6 2023-09-20 23:02:57,472 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-20 23:02:57,473 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-20 23:02:57,473 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-20 23:02:57,473 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,474 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:57,474 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,474 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,474 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:57,474 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:57,474 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,474 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:57,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-20 23:02:57,477 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309203881dcac7aa84cd49f3184753240709e to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309203881dcac7aa84cd49f3184753240709e 2023-09-20 23:02:57,478 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309205b18ea040c5f406da43937d19611c59f to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309205b18ea040c5f406da43937d19611c59f 2023-09-20 23:02:57,479 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-20 23:02:57,480 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,482 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-20 23:02:57,484 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-20 23:02:57,485 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,485 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-20 23:02:57,485 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250977485"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:57,485 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250977485"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:57,486 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 23:02:57,487 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cd72744d887503d56189c5555c0a4eb6, NAME => 'testtb-testEmptyExportFileSystemState,,1695250966157.cd72744d887503d56189c5555c0a4eb6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5495126eafef6885729fdd997998fea0, NAME => 'testtb-testEmptyExportFileSystemState,1,1695250966157.5495126eafef6885729fdd997998fea0.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 23:02:57,487 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-20 23:02:57,487 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695250977487"}]},"ts":"9223372036854775807"} 2023-09-20 23:02:57,494 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-20 23:02:57,495 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-20 23:02:57,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 40 msec 2023-09-20 23:02:57,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-20 23:02:57,576 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-20 23:02:57,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-20 23:02:57,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:57,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-20 23:02:57,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-20 23:02:57,615 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 759) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:38734 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4725 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3f712515-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1511478988) connection to jenkins-hbase4.apache.org/172.31.14.131:43013 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937698548_1 at /127.0.0.1:60910 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:56852 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1536447544_17 at /127.0.0.1:51876 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f712515-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1511478988) connection to jenkins-hbase4.apache.org/172.31.14.131:36749 from appattempt_1695250885278_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937698548_1 at /127.0.0.1:46548 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1511478988) connection to jenkins-hbase4.apache.org/172.31.14.131:37463 from appattempt_1695250885278_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3f712515-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=98 (was 115), ProcessCount=168 (was 168), AvailableMemoryMB=2890 (was 3020) 2023-09-20 23:02:57,615 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-20 23:02:57,634 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=98, ProcessCount=168, AvailableMemoryMB=2889 2023-09-20 23:02:57,634 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-20 23:02:57,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-20 23:02:57,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:57,639 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-20 23:02:57,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-20 23:02:57,639 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-20 23:02:57,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-20 23:02:57,642 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:02:57,642 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec 2023-09-20 23:02:57,642 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c empty. 2023-09-20 23:02:57,642 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec empty. 2023-09-20 23:02:57,643 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:02:57,643 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec 2023-09-20 23:02:57,643 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-20 23:02:57,652 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-20 23:02:57,653 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => e949d664fa79944ccdc93086f2b5fa5c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:02:57,654 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 21f480617c9e590cf81429e2b84863ec, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp 2023-09-20 23:02:57,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:57,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 21f480617c9e590cf81429e2b84863ec, disabling compactions & flushes 2023-09-20 23:02:57,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:57,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:57,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. after waiting 0 ms 2023-09-20 23:02:57,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:57,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:57,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 21f480617c9e590cf81429e2b84863ec: 2023-09-20 23:02:57,670 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:57,670 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing e949d664fa79944ccdc93086f2b5fa5c, disabling compactions & flushes 2023-09-20 23:02:57,670 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:57,670 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:57,670 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. after waiting 0 ms 2023-09-20 23:02:57,671 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:57,671 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:57,671 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for e949d664fa79944ccdc93086f2b5fa5c: 2023-09-20 23:02:57,673 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-20 23:02:57,674 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695250977674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250977674"}]},"ts":"1695250977674"} 2023-09-20 23:02:57,674 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695250977674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250977674"}]},"ts":"1695250977674"} 2023-09-20 23:02:57,676 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-20 23:02:57,677 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-20 23:02:57,677 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250977677"}]},"ts":"1695250977677"} 2023-09-20 23:02:57,678 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-20 23:02:57,681 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-20 23:02:57,682 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-20 23:02:57,682 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-20 23:02:57,682 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-20 23:02:57,682 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-20 23:02:57,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e949d664fa79944ccdc93086f2b5fa5c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21f480617c9e590cf81429e2b84863ec, ASSIGN}] 2023-09-20 23:02:57,684 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e949d664fa79944ccdc93086f2b5fa5c, ASSIGN 2023-09-20 23:02:57,685 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21f480617c9e590cf81429e2b84863ec, ASSIGN 2023-09-20 23:02:57,685 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e949d664fa79944ccdc93086f2b5fa5c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35407,1695250878922; forceNewPlan=false, retain=false 2023-09-20 23:02:57,685 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21f480617c9e590cf81429e2b84863ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42935,1695250878960; forceNewPlan=false, retain=false 2023-09-20 23:02:57,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-20 23:02:57,835 INFO [jenkins-hbase4:45915] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-20 23:02:57,838 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=21f480617c9e590cf81429e2b84863ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:57,838 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e949d664fa79944ccdc93086f2b5fa5c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:57,838 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695250977838"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250977838"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250977838"}]},"ts":"1695250977838"} 2023-09-20 23:02:57,838 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695250977838"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250977838"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250977838"}]},"ts":"1695250977838"} 2023-09-20 23:02:57,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 21f480617c9e590cf81429e2b84863ec, server=jenkins-hbase4.apache.org,42935,1695250878960}] 2023-09-20 23:02:57,840 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure e949d664fa79944ccdc93086f2b5fa5c, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:02:57,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-20 23:02:57,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:57,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:57,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e949d664fa79944ccdc93086f2b5fa5c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.', STARTKEY => '', ENDKEY => '1'} 2023-09-20 23:02:57,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 21f480617c9e590cf81429e2b84863ec, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.', STARTKEY => '1', ENDKEY => ''} 2023-09-20 23:02:57,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. service=AccessControlService 2023-09-20 23:02:57,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. service=AccessControlService 2023-09-20 23:02:57,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:57,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-20 23:02:57,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:02:57,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 21f480617c9e590cf81429e2b84863ec 2023-09-20 23:02:57,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:57,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-20 23:02:57,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:02:57,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 21f480617c9e590cf81429e2b84863ec 2023-09-20 23:02:57,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:02:57,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 21f480617c9e590cf81429e2b84863ec 2023-09-20 23:02:57,996 INFO [StoreOpener-21f480617c9e590cf81429e2b84863ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 21f480617c9e590cf81429e2b84863ec 2023-09-20 23:02:57,996 INFO [StoreOpener-e949d664fa79944ccdc93086f2b5fa5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:02:57,998 DEBUG [StoreOpener-21f480617c9e590cf81429e2b84863ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/cf 2023-09-20 23:02:57,998 DEBUG [StoreOpener-21f480617c9e590cf81429e2b84863ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/cf 2023-09-20 23:02:57,998 DEBUG [StoreOpener-e949d664fa79944ccdc93086f2b5fa5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/cf 2023-09-20 23:02:57,998 DEBUG [StoreOpener-e949d664fa79944ccdc93086f2b5fa5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/cf 2023-09-20 23:02:57,998 INFO [StoreOpener-21f480617c9e590cf81429e2b84863ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f480617c9e590cf81429e2b84863ec columnFamilyName cf 2023-09-20 23:02:57,998 INFO [StoreOpener-e949d664fa79944ccdc93086f2b5fa5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e949d664fa79944ccdc93086f2b5fa5c columnFamilyName cf 2023-09-20 23:02:57,999 INFO [StoreOpener-e949d664fa79944ccdc93086f2b5fa5c-1] regionserver.HStore(310): Store=e949d664fa79944ccdc93086f2b5fa5c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:57,999 INFO [StoreOpener-21f480617c9e590cf81429e2b84863ec-1] regionserver.HStore(310): Store=21f480617c9e590cf81429e2b84863ec/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-20 23:02:58,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:02:58,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec 2023-09-20 23:02:58,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:02:58,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec 2023-09-20 23:02:58,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:02:58,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 21f480617c9e590cf81429e2b84863ec 2023-09-20 23:02:58,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:02:58,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-20 23:02:58,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e949d664fa79944ccdc93086f2b5fa5c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60688575, jitterRate=-0.09566976130008698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:58,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e949d664fa79944ccdc93086f2b5fa5c: 2023-09-20 23:02:58,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 21f480617c9e590cf81429e2b84863ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65412247, jitterRate=-0.02528156340122223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-20 23:02:58,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 21f480617c9e590cf81429e2b84863ec: 2023-09-20 23:02:58,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec., pid=108, masterSystemTime=1695250977991 2023-09-20 23:02:58,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c., pid=109, masterSystemTime=1695250977991 2023-09-20 23:02:58,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:58,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:58,007 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=21f480617c9e590cf81429e2b84863ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:58,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:58,008 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695250978007"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250978007"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250978007"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250978007"}]},"ts":"1695250978007"} 2023-09-20 23:02:58,008 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e949d664fa79944ccdc93086f2b5fa5c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,008 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695250978008"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695250978008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695250978008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695250978008"}]},"ts":"1695250978008"} 2023-09-20 23:02:58,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-20 23:02:58,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 21f480617c9e590cf81429e2b84863ec, server=jenkins-hbase4.apache.org,42935,1695250878960 in 169 msec 2023-09-20 23:02:58,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-20 23:02:58,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure e949d664fa79944ccdc93086f2b5fa5c, server=jenkins-hbase4.apache.org,35407,1695250878922 in 170 msec 2023-09-20 23:02:58,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21f480617c9e590cf81429e2b84863ec, ASSIGN in 327 msec 2023-09-20 23:02:58,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-20 23:02:58,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e949d664fa79944ccdc93086f2b5fa5c, ASSIGN in 328 msec 2023-09-20 23:02:58,013 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-20 23:02:58,013 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250978013"}]},"ts":"1695250978013"} 2023-09-20 23:02:58,014 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-20 23:02:58,016 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-20 23:02:58,016 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-20 23:02:58,018 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-20 23:02:58,019 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:58,019 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:58,019 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:58,019 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:02:58,020 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:58,020 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:58,020 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:58,020 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-20 23:02:58,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 384 msec 2023-09-20 23:02:58,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-20 23:02:58,243 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-20 23:02:58,245 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,245 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:58,247 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:02:58,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 23:02:58,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250978261 (current time:1695250978261). 2023-09-20 23:02:58,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:02:58,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x7cdafd1d to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:58,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1740cde5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:58,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:58,274 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:58,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cdafd1d to 127.0.0.1:53756 2023-09-20 23:02:58,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:58,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x61eda0f7 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:58,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4af49bc2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:58,282 DEBUG [hconnection-0x5bca489c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:58,284 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:58,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:58,290 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:58,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61eda0f7 to 127.0.0.1:53756 2023-09-20 23:02:58,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:58,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-20 23:02:58,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:02:58,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 23:02:58,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 23:02:58,294 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 23:02:58,295 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695251578295 2023-09-20 23:02:58,295 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 23:02:58,296 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:02:58,296 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:02:58,297 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 23:02:58,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 23:02:58,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-20 23:02:58,299 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 23:02:58,299 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695251578299 2023-09-20 23:02:58,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,308 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-20 23:02:58,308 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:58,309 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-20 23:02:58,309 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-20 23:02:58,309 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,310 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,312 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,312 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,312 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,312 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,312 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,312 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,313 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,313 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:02:58,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-20 23:02:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-20 23:02:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-20 23:02:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 23:02:58,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 23:02:58,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 23:02:58,314 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,314 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 23:02:58,314 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:58,314 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,315 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 23:02:58,315 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 23:02:58,315 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:58,314 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,316 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 23:02:58,316 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 23:02:58,316 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:58,315 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 23:02:58,316 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 23:02:58,317 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 23:02:58,316 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 23:02:58,316 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 23:02:58,317 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 23:02:58,317 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 23:02:58,322 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:58,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:58,322 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:58,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-20 23:02:58,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e745e13[Count = 1] remaining members to acquire global barrier 2023-09-20 23:02:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:58,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-20 23:02:58,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e745e13[Count = 0] remaining members to acquire global barrier 2023-09-20 23:02:58,326 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-20 23:02:58,326 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,328 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,328 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,328 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 23:02:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 23:02:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:02:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 23:02:58,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,328 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:58,328 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 23:02:58,328 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. started... 2023-09-20 23:02:58,328 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,328 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:02:58,329 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:58,329 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:58,329 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e949d664fa79944ccdc93086f2b5fa5c: 2023-09-20 23:02:58,329 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:58,329 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. started... 2023-09-20 23:02:58,329 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,329 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:58,329 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:02:58,330 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 21f480617c9e590cf81429e2b84863ec: 2023-09-20 23:02:58,330 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,330 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 23:02:58,330 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:58,330 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:58,330 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 23:02:58,331 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-20 23:02:58,349 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. completed. 2023-09-20 23:02:58,349 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:58,349 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:58,349 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:58,349 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,349 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 23:02:58,349 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:02:58,351 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,351 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 23:02:58,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:58,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:58,351 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:58,351 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 23:02:58,353 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. completed. 2023-09-20 23:02:58,353 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:58,353 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:58,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:58,353 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:58,353 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,353 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 23:02:58,353 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:02:58,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:58,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,354 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,354 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 23:02:58,354 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:58,354 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 23:02:58,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:58,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35407,1695250878922': 2023-09-20 23:02:58,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-20 23:02:58,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:58,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:58,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:58,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:58,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:58,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42935,1695250878960': 2023-09-20 23:02:58,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-20 23:02:58,361 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-20 23:02:58,361 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:02:58,361 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:02:58,361 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,361 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:02:58,363 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:58,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:58,363 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,363 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:58,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,364 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,364 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:58,365 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:58,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,366 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,366 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,367 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,369 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,369 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,369 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,369 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,369 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,369 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:58,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,369 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,369 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,369 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,369 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:02:58,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,370 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,371 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,371 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,371 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,371 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,371 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,371 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-20 23:02:58,371 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,397 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:58,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-20 23:02:58,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:02:58,398 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:02:58,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-20 23:02:58,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,411 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695250978295Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695250978380 (+85 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695250978380Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695250978380Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695250978383 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695250978404 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695250978410 (+6 ms) 2023-09-20 23:02:58,414 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 23:02:58,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 118 msec 2023-09-20 23:02:58,598 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:58,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-20 23:02:58,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:02:58,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35407] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:02:58,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42935] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. with WAL disabled. Data may be lost in the event of a crash. 2023-09-20 23:02:58,604 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,605 DEBUG [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:58,605 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-20 23:02:58,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 23:02:58,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695250978613 (current time:1695250978613). 2023-09-20 23:02:58,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-20 23:02:58,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x651ea279 to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:58,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c1988ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:58,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:58,621 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:58,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x651ea279 to 127.0.0.1:53756 2023-09-20 23:02:58,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:58,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(139): Connect 0x57d4504f to 127.0.0.1:53756 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-20 23:02:58,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47493da6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-20 23:02:58,630 DEBUG [hconnection-0x67378359-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:58,632 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:58,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-20 23:02:58,641 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-20 23:02:58,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57d4504f to 127.0.0.1:53756 2023-09-20 23:02:58,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:02:58,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-20 23:02:58,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-20 23:02:58,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 23:02:58,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 23:02:58,646 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 23:02:58,647 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695251578646 2023-09-20 23:02:58,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-20 23:02:58,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,648 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-20 23:02:58,648 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-20 23:02:58,649 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-20 23:02:58,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 23:02:58,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-20 23:02:58,650 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 23:02:58,651 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695251578651 2023-09-20 23:02:58,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,661 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-20 23:02:58,662 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:58,663 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-20 23:02:58,663 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-20 23:02:58,663 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,663 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,665 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,665 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,665 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,665 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,665 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,665 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,666 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,666 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-20 23:02:58,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 23:02:58,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 23:02:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-20 23:02:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:58,667 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-20 23:02:58,668 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 23:02:58,669 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 23:02:58,669 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 23:02:58,669 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 23:02:58,669 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 23:02:58,669 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35755,1695250878873' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 23:02:58,668 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-20 23:02:58,669 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-20 23:02:58,669 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-20 23:02:58,670 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,671 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:58,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,673 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,673 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-20 23:02:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:58,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42935,1695250878960' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-20 23:02:58,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@220e0f27[Count = 1] remaining members to acquire global barrier 2023-09-20 23:02:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:58,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35407,1695250878922' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-20 23:02:58,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@220e0f27[Count = 0] remaining members to acquire global barrier 2023-09-20 23:02:58,676 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-20 23:02:58,676 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,680 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,680 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,680 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,680 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,680 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 23:02:58,680 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 23:02:58,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,680 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:58,680 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:58,680 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:58,680 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,680 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-20 23:02:58,680 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-20 23:02:58,680 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. started... 2023-09-20 23:02:58,680 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:58,680 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-20 23:02:58,681 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-20 23:02:58,681 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. started... 2023-09-20 23:02:58,680 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 23:02:58,681 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 21f480617c9e590cf81429e2b84863ec 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-20 23:02:58,681 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e949d664fa79944ccdc93086f2b5fa5c 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-20 23:02:58,681 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35755,1695250878873' in zk 2023-09-20 23:02:58,682 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 23:02:58,682 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:58,682 DEBUG [member: 'jenkins-hbase4.apache.org,35755,1695250878873' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 23:02:58,697 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230920cb2f41bac17d421e960b9b36c892ee94 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230920cb2f41bac17d421e960b9b36c892ee94 2023-09-20 23:02:58,697 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309200bc63ef3e7d9444085d8d5d054865e7c to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309200bc63ef3e7d9444085d8d5d054865e7c 2023-09-20 23:02:58,706 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/.tmp/cf/b6e78f24aedc4cde940764407ef313aa 2023-09-20 23:02:58,706 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/.tmp/cf/cec892832f9e4e5ea0c40bd2a330ffdd 2023-09-20 23:02:58,711 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/.tmp/cf/cec892832f9e4e5ea0c40bd2a330ffdd as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/cf/cec892832f9e4e5ea0c40bd2a330ffdd 2023-09-20 23:02:58,711 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/.tmp/cf/b6e78f24aedc4cde940764407ef313aa as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/cf/b6e78f24aedc4cde940764407ef313aa 2023-09-20 23:02:58,716 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/cf/cec892832f9e4e5ea0c40bd2a330ffdd, entries=48, sequenceid=6, filesize=13.5 K 2023-09-20 23:02:58,716 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/cf/b6e78f24aedc4cde940764407ef313aa, entries=2, sequenceid=6, filesize=5.2 K 2023-09-20 23:02:58,717 INFO [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for e949d664fa79944ccdc93086f2b5fa5c in 36ms, sequenceid=6, compaction requested=false 2023-09-20 23:02:58,717 INFO [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 21f480617c9e590cf81429e2b84863ec in 36ms, sequenceid=6, compaction requested=false 2023-09-20 23:02:58,717 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-20 23:02:58,717 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-20 23:02:58,720 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e949d664fa79944ccdc93086f2b5fa5c: 2023-09-20 23:02:58,720 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 21f480617c9e590cf81429e2b84863ec: 2023-09-20 23:02:58,720 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,720 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,720 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:58,720 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-20 23:02:58,720 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/cf/b6e78f24aedc4cde940764407ef313aa] hfiles 2023-09-20 23:02:58,720 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/cf/cec892832f9e4e5ea0c40bd2a330ffdd] hfiles 2023-09-20 23:02:58,720 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/cf/b6e78f24aedc4cde940764407ef313aa for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,720 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/cf/cec892832f9e4e5ea0c40bd2a330ffdd for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,733 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. completed. 2023-09-20 23:02:58,733 DEBUG [rs(jenkins-hbase4.apache.org,35407,1695250878922)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:02:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:58,733 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. completed. 2023-09-20 23:02:58,733 DEBUG [rs(jenkins-hbase4.apache.org,42935,1695250878960)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:02:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-20 23:02:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-20 23:02:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 23:02:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-20 23:02:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35407,1695250878922' in zk 2023-09-20 23:02:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42935,1695250878960' in zk 2023-09-20 23:02:58,736 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,736 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 23:02:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:58,736 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:58,736 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,736 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-20 23:02:58,736 DEBUG [member: 'jenkins-hbase4.apache.org,35407,1695250878922' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 23:02:58,737 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:58,737 DEBUG [member: 'jenkins-hbase4.apache.org,42935,1695250878960' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-20 23:02:58,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42935,1695250878960': 2023-09-20 23:02:58,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42935,1695250878960' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-20 23:02:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35407,1695250878922': 2023-09-20 23:02:58,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35407,1695250878922' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-20 23:02:58,743 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-20 23:02:58,744 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-20 23:02:58,744 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-20 23:02:58,744 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,744 INFO [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-20 23:02:58,745 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,745 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-20 23:02:58,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-20 23:02:58,745 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,745 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,745 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,745 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,746 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,745 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-20 23:02:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,746 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,746 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-20 23:02:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,748 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:58,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-20 23:02:58,748 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,748 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-20 23:02:58,749 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-20 23:02:58,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,749 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-20 23:02:58,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-20 23:02:58,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-20 23:02:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,752 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,751 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,752 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:02:58,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,752 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,751 DEBUG [(jenkins-hbase4.apache.org,45915,1695250877567)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-20 23:02:58,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,751 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-20 23:02:58,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,752 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:02:58,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-20 23:02:58,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-20 23:02:58,753 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:02:58,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,754 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,754 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-20 23:02:58,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-20 23:02:58,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309200bc63ef3e7d9444085d8d5d054865e7c, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230920cb2f41bac17d421e960b9b36c892ee94] mob files 2023-09-20 23:02:58,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309200bc63ef3e7d9444085d8d5d054865e7c 2023-09-20 23:02:58,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230920cb2f41bac17d421e960b9b36c892ee94 2023-09-20 23:02:58,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,780 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-20 23:02:58,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,781 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695250978647Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695250978761 (+114 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695250978761Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695250978761Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695250978764 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695250978774 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695250978780 (+6 ms) 2023-09-20 23:02:58,783 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-20 23:02:58,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 136 msec 2023-09-20 23:02:58,949 DEBUG [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-20 23:02:58,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-20 23:02:58,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-20 23:02:58,951 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250978951 2023-09-20 23:02:58,951 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37461, tgtDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250978951, rawTgtDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250978951, srcFsUri=hdfs://localhost:37461, srcDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:02:58,972 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611 2023-09-20 23:02:58,972 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-914301261_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250978951, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250978951/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,973 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37461, inputRoot=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611, snapshotDir=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-20 23:02:58,980 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250978951/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:02:58,994 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:58,994 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:58,994 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:58,995 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:59,870 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-350308308534849322.jar 2023-09-20 23:02:59,871 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:59,871 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:59,938 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/hadoop-8169991332237013373.jar 2023-09-20 23:02:59,938 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:59,939 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:59,939 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:59,939 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:59,940 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:59,940 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-20 23:02:59,940 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-20 23:02:59,941 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-20 23:02:59,941 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-20 23:02:59,941 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-20 23:02:59,942 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-20 23:02:59,942 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-20 23:02:59,943 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-20 23:02:59,943 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-20 23:02:59,943 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-20 23:02:59,944 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-20 23:02:59,944 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:59,945 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:59,945 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:59,945 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:59,945 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-20 23:02:59,946 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:02:59,946 DEBUG [Listener at jenkins-hbase4.apache.org/44443] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-20 23:03:00,278 WARN [Listener at jenkins-hbase4.apache.org/44443] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-20 23:03:00,281 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-20 23:03:00,283 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-20 23:03:01,404 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:03:01,404 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-20 23:03:01,410 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0006_000001 (auth:SIMPLE) 2023-09-20 23:03:01,795 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0007_000001 (auth:SIMPLE) 2023-09-20 23:03:02,939 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 23:03:05,408 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0007_000001 (auth:SIMPLE) 2023-09-20 23:03:07,616 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0007_000001 (auth:SIMPLE) 2023-09-20 23:03:10,136 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695250885278_0007_000001 (auth:SIMPLE) 2023-09-20 23:03:11,462 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-20 23:03:11,463 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-20 23:03:11,473 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,473 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-20 23:03:11,474 INFO [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-20 23:03:11,474 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,474 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-20 23:03:11,474 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-20 23:03:11,474 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536447544_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250978951/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250978951/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,475 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250978951/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-20 23:03:11,475 DEBUG [Listener at jenkins-hbase4.apache.org/44443] snapshot.TestExportSnapshot(367): hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/export-test/export-1695250978951/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-20 23:03:11,481 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,486 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250991486"}]},"ts":"1695250991486"} 2023-09-20 23:03:11,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-20 23:03:11,488 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-20 23:03:11,489 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-20 23:03:11,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e949d664fa79944ccdc93086f2b5fa5c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21f480617c9e590cf81429e2b84863ec, UNASSIGN}] 2023-09-20 23:03:11,492 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e949d664fa79944ccdc93086f2b5fa5c, UNASSIGN 2023-09-20 23:03:11,492 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21f480617c9e590cf81429e2b84863ec, UNASSIGN 2023-09-20 23:03:11,493 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e949d664fa79944ccdc93086f2b5fa5c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:03:11,493 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=21f480617c9e590cf81429e2b84863ec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:03:11,493 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695250991493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250991493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250991493"}]},"ts":"1695250991493"} 2023-09-20 23:03:11,493 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695250991493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695250991493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695250991493"}]},"ts":"1695250991493"} 2023-09-20 23:03:11,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure e949d664fa79944ccdc93086f2b5fa5c, server=jenkins-hbase4.apache.org,35407,1695250878922}] 2023-09-20 23:03:11,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 21f480617c9e590cf81429e2b84863ec, server=jenkins-hbase4.apache.org,42935,1695250878960}] 2023-09-20 23:03:11,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-20 23:03:11,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:03:11,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 21f480617c9e590cf81429e2b84863ec 2023-09-20 23:03:11,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e949d664fa79944ccdc93086f2b5fa5c, disabling compactions & flushes 2023-09-20 23:03:11,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 21f480617c9e590cf81429e2b84863ec, disabling compactions & flushes 2023-09-20 23:03:11,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:03:11,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:03:11,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:03:11,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:03:11,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. after waiting 0 ms 2023-09-20 23:03:11,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:03:11,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. after waiting 0 ms 2023-09-20 23:03:11,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:03:11,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:03:11,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:03:11,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:03:11,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:03:11,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec. 2023-09-20 23:03:11,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 21f480617c9e590cf81429e2b84863ec: 2023-09-20 23:03:11,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c. 2023-09-20 23:03:11,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e949d664fa79944ccdc93086f2b5fa5c: 2023-09-20 23:03:11,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:03:11,659 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e949d664fa79944ccdc93086f2b5fa5c, regionState=CLOSED 2023-09-20 23:03:11,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 21f480617c9e590cf81429e2b84863ec 2023-09-20 23:03:11,660 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695250991659"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250991659"}]},"ts":"1695250991659"} 2023-09-20 23:03:11,660 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=21f480617c9e590cf81429e2b84863ec, regionState=CLOSED 2023-09-20 23:03:11,660 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695250991660"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695250991660"}]},"ts":"1695250991660"} 2023-09-20 23:03:11,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-20 23:03:11,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure e949d664fa79944ccdc93086f2b5fa5c, server=jenkins-hbase4.apache.org,35407,1695250878922 in 167 msec 2023-09-20 23:03:11,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-20 23:03:11,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 21f480617c9e590cf81429e2b84863ec, server=jenkins-hbase4.apache.org,42935,1695250878960 in 166 msec 2023-09-20 23:03:11,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e949d664fa79944ccdc93086f2b5fa5c, UNASSIGN in 172 msec 2023-09-20 23:03:11,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-20 23:03:11,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21f480617c9e590cf81429e2b84863ec, UNASSIGN in 173 msec 2023-09-20 23:03:11,666 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695250991666"}]},"ts":"1695250991666"} 2023-09-20 23:03:11,667 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-20 23:03:11,668 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-20 23:03:11,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 187 msec 2023-09-20 23:03:11,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-20 23:03:11,789 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-20 23:03:11,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,792 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,793 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,794 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35407] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,797 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:03:11,797 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec 2023-09-20 23:03:11,798 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,798 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,798 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,798 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-20 23:03:11,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-20 23:03:11,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-20 23:03:11,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-20 23:03:11,799 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/recovered.edits] 2023-09-20 23:03:11,799 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,799 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,799 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,799 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:03:11,800 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/cf, FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/recovered.edits] 2023-09-20 23:03:11,799 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,800 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:03:11,799 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:03:11,800 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-20 23:03:11,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-20 23:03:11,803 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/cf/b6e78f24aedc4cde940764407ef313aa to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/cf/b6e78f24aedc4cde940764407ef313aa 2023-09-20 23:03:11,803 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/cf/cec892832f9e4e5ea0c40bd2a330ffdd to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/cf/cec892832f9e4e5ea0c40bd2a330ffdd 2023-09-20 23:03:11,806 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c/recovered.edits/9.seqid 2023-09-20 23:03:11,806 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/recovered.edits/9.seqid to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec/recovered.edits/9.seqid 2023-09-20 23:03:11,807 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e949d664fa79944ccdc93086f2b5fa5c 2023-09-20 23:03:11,807 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21f480617c9e590cf81429e2b84863ec 2023-09-20 23:03:11,807 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-20 23:03:11,807 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-20 23:03:11,808 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-20 23:03:11,812 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309200bc63ef3e7d9444085d8d5d054865e7c to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309200bc63ef3e7d9444085d8d5d054865e7c 2023-09-20 23:03:11,813 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230920cb2f41bac17d421e960b9b36c892ee94 to hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230920cb2f41bac17d421e960b9b36c892ee94 2023-09-20 23:03:11,814 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-20 23:03:11,816 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,818 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-20 23:03:11,820 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-20 23:03:11,821 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,821 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-20 23:03:11,821 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250991821"}]},"ts":"9223372036854775807"} 2023-09-20 23:03:11,821 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695250991821"}]},"ts":"9223372036854775807"} 2023-09-20 23:03:11,822 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-20 23:03:11,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e949d664fa79944ccdc93086f2b5fa5c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695250977636.e949d664fa79944ccdc93086f2b5fa5c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 21f480617c9e590cf81429e2b84863ec, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695250977636.21f480617c9e590cf81429e2b84863ec.', STARTKEY => '1', ENDKEY => ''}] 2023-09-20 23:03:11,823 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-20 23:03:11,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695250991823"}]},"ts":"9223372036854775807"} 2023-09-20 23:03:11,824 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-20 23:03:11,826 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-09-20 23:03:11,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-20 23:03:11,901 INFO [Listener at jenkins-hbase4.apache.org/44443] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-20 23:03:11,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-20 23:03:11,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-20 23:03:11,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45915] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-20 23:03:11,936 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 766), OpenFileDescriptor=912 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=145 (was 98) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=2824 (was 2889) 2023-09-20 23:03:11,936 WARN [Listener at jenkins-hbase4.apache.org/44443] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-20 23:03:11,936 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-20 23:03:11,948 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-20 23:03:12,059 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695250885278_0007_01_000001 is : 143 2023-09-20 23:03:17,223 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-20 23:03:26,073 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-20 23:03:40,193 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-20 23:03:40,193 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-20 23:03:40,303 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-20 23:03:40,311 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-20 23:03:40,312 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-20 23:03:40,319 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-20 23:03:40,423 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-20 23:03:40,423 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-20 23:03:40,423 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-20 23:03:40,423 INFO [Listener at jenkins-hbase4.apache.org/44443] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-20 23:03:40,423 DEBUG [Listener at jenkins-hbase4.apache.org/44443] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bf08614 to 127.0.0.1:53756 2023-09-20 23:03:40,423 DEBUG [Listener at jenkins-hbase4.apache.org/44443] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:03:40,423 DEBUG [Listener at jenkins-hbase4.apache.org/44443] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-20 23:03:40,423 DEBUG [Listener at jenkins-hbase4.apache.org/44443] util.JVMClusterUtil(257): Found active master hash=754312019, stopped=false 2023-09-20 23:03:40,424 DEBUG [Listener at jenkins-hbase4.apache.org/44443] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:03:40,424 DEBUG [Listener at jenkins-hbase4.apache.org/44443] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-20 23:03:40,424 INFO [Listener at jenkins-hbase4.apache.org/44443] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45915,1695250877567 2023-09-20 23:03:40,425 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-20 23:03:40,425 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-20 23:03:40,425 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-20 23:03:40,425 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-20 23:03:40,425 INFO [Listener at jenkins-hbase4.apache.org/44443] procedure2.ProcedureExecutor(628): Stopping 2023-09-20 23:03:40,425 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:03:40,425 DEBUG [Listener at jenkins-hbase4.apache.org/44443] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c4a0cc9 to 127.0.0.1:53756 2023-09-20 23:03:40,426 DEBUG [Listener at jenkins-hbase4.apache.org/44443] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:03:40,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 23:03:40,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 23:03:40,426 INFO [Listener at jenkins-hbase4.apache.org/44443] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35755,1695250878873' ***** 2023-09-20 23:03:40,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 23:03:40,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-20 23:03:40,426 DEBUG [Listener at jenkins-hbase4.apache.org/44443] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:03:40,426 INFO [Listener at jenkins-hbase4.apache.org/44443] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-20 23:03:40,426 INFO [Listener at jenkins-hbase4.apache.org/44443] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35407,1695250878922' ***** 2023-09-20 23:03:40,426 DEBUG [Listener at jenkins-hbase4.apache.org/44443] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:03:40,426 INFO [RS:0;jenkins-hbase4:35755] regionserver.HeapMemoryManager(220): Stopping 2023-09-20 23:03:40,426 INFO [Listener at jenkins-hbase4.apache.org/44443] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-20 23:03:40,427 INFO [Listener at jenkins-hbase4.apache.org/44443] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42935,1695250878960' ***** 2023-09-20 23:03:40,427 INFO [RS:0;jenkins-hbase4:35755] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-20 23:03:40,427 DEBUG [Listener at jenkins-hbase4.apache.org/44443] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:03:40,427 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-20 23:03:40,427 INFO [RS:0;jenkins-hbase4:35755] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-20 23:03:40,427 INFO [RS:1;jenkins-hbase4:35407] regionserver.HeapMemoryManager(220): Stopping 2023-09-20 23:03:40,427 INFO [Listener at jenkins-hbase4.apache.org/44443] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-20 23:03:40,427 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-20 23:03:40,427 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(3305): Received CLOSE for c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:03:40,427 INFO [RS:1;jenkins-hbase4:35407] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-20 23:03:40,427 INFO [RS:2;jenkins-hbase4:42935] regionserver.HeapMemoryManager(220): Stopping 2023-09-20 23:03:40,427 INFO [RS:1;jenkins-hbase4:35407] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-20 23:03:40,427 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-20 23:03:40,427 INFO [RS:2;jenkins-hbase4:42935] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-20 23:03:40,427 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:03:40,427 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(3305): Received CLOSE for 65403148c07c561bce9cf55676881f92 2023-09-20 23:03:40,427 INFO [RS:2;jenkins-hbase4:42935] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-20 23:03:40,428 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:03:40,428 INFO [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:03:40,429 DEBUG [RS:1;jenkins-hbase4:35407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79ec310a to 127.0.0.1:53756 2023-09-20 23:03:40,429 DEBUG [RS:2;jenkins-hbase4:42935] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3dec1d76 to 127.0.0.1:53756 2023-09-20 23:03:40,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c72413fec41daeda57cd9b7e6e2e810b, disabling compactions & flushes 2023-09-20 23:03:40,428 DEBUG [RS:0;jenkins-hbase4:35755] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18138d6d to 127.0.0.1:53756 2023-09-20 23:03:40,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:03:40,429 DEBUG [RS:2;jenkins-hbase4:42935] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:03:40,429 DEBUG [RS:1;jenkins-hbase4:35407] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:03:40,432 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-20 23:03:40,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 65403148c07c561bce9cf55676881f92, disabling compactions & flushes 2023-09-20 23:03:40,432 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-20 23:03:40,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:03:40,432 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-20 23:03:40,432 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-20 23:03:40,432 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1478): Online Regions={65403148c07c561bce9cf55676881f92=hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92.} 2023-09-20 23:03:40,432 INFO [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42935,1695250878960; all regions closed. 2023-09-20 23:03:40,432 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-20 23:03:40,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:03:40,429 DEBUG [RS:0;jenkins-hbase4:35755] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:03:40,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. after waiting 0 ms 2023-09-20 23:03:40,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:03:40,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:03:40,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c72413fec41daeda57cd9b7e6e2e810b 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-20 23:03:40,433 INFO [RS:0;jenkins-hbase4:35755] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-20 23:03:40,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. after waiting 0 ms 2023-09-20 23:03:40,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:03:40,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 65403148c07c561bce9cf55676881f92 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-20 23:03:40,434 DEBUG [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1504): Waiting on 65403148c07c561bce9cf55676881f92 2023-09-20 23:03:40,433 INFO [RS:0;jenkins-hbase4:35755] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-20 23:03:40,434 INFO [RS:0;jenkins-hbase4:35755] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-20 23:03:40,434 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-20 23:03:40,434 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-20 23:03:40,434 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1478): Online Regions={c72413fec41daeda57cd9b7e6e2e810b=hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b., 1588230740=hbase:meta,,1.1588230740} 2023-09-20 23:03:40,435 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-20 23:03:40,435 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-20 23:03:40,435 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-20 23:03:40,435 DEBUG [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1504): Waiting on 1588230740, c72413fec41daeda57cd9b7e6e2e810b 2023-09-20 23:03:40,435 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-20 23:03:40,435 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-20 23:03:40,435 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-20 23:03:40,436 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-20 23:03:40,436 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-20 23:03:40,466 DEBUG [RS:2;jenkins-hbase4:42935] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/oldWALs 2023-09-20 23:03:40,466 INFO [RS:2;jenkins-hbase4:42935] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42935%2C1695250878960:(num 1695250880599) 2023-09-20 23:03:40,467 DEBUG [RS:2;jenkins-hbase4:42935] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:03:40,467 INFO [RS:2;jenkins-hbase4:42935] regionserver.LeaseManager(133): Closed leases 2023-09-20 23:03:40,473 INFO [RS:2;jenkins-hbase4:42935] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-20 23:03:40,473 INFO [RS:2;jenkins-hbase4:42935] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-20 23:03:40,473 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-20 23:03:40,473 INFO [RS:2;jenkins-hbase4:42935] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-20 23:03:40,474 INFO [RS:2;jenkins-hbase4:42935] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-20 23:03:40,475 INFO [RS:2;jenkins-hbase4:42935] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42935 2023-09-20 23:03:40,476 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/.tmp/info/4e197e1798a643839285a43f8865e779 2023-09-20 23:03:40,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b/.tmp/info/4b102f9b476c48dbb88c5b4498a34332 2023-09-20 23:03:40,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/acl/65403148c07c561bce9cf55676881f92/.tmp/l/b439d97ef678410f9b5bb1558de4c7e8 2023-09-20 23:03:40,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b439d97ef678410f9b5bb1558de4c7e8 2023-09-20 23:03:40,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/acl/65403148c07c561bce9cf55676881f92/.tmp/l/b439d97ef678410f9b5bb1558de4c7e8 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/acl/65403148c07c561bce9cf55676881f92/l/b439d97ef678410f9b5bb1558de4c7e8 2023-09-20 23:03:40,487 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:03:40,487 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 23:03:40,487 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:03:40,487 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 23:03:40,487 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 23:03:40,487 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42935,1695250878960 2023-09-20 23:03:40,487 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 23:03:40,488 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42935,1695250878960] 2023-09-20 23:03:40,489 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42935,1695250878960; numProcessing=1 2023-09-20 23:03:40,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b439d97ef678410f9b5bb1558de4c7e8 2023-09-20 23:03:40,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/acl/65403148c07c561bce9cf55676881f92/l/b439d97ef678410f9b5bb1558de4c7e8, entries=7, sequenceid=18, filesize=5.2 K 2023-09-20 23:03:40,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e197e1798a643839285a43f8865e779 2023-09-20 23:03:40,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 65403148c07c561bce9cf55676881f92 in 57ms, sequenceid=18, compaction requested=false 2023-09-20 23:03:40,491 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42935,1695250878960 already deleted, retry=false 2023-09-20 23:03:40,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b/.tmp/info/4b102f9b476c48dbb88c5b4498a34332 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b/info/4b102f9b476c48dbb88c5b4498a34332 2023-09-20 23:03:40,492 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42935,1695250878960 expired; onlineServers=2 2023-09-20 23:03:40,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b/info/4b102f9b476c48dbb88c5b4498a34332, entries=2, sequenceid=6, filesize=4.8 K 2023-09-20 23:03:40,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c72413fec41daeda57cd9b7e6e2e810b in 66ms, sequenceid=6, compaction requested=false 2023-09-20 23:03:40,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/acl/65403148c07c561bce9cf55676881f92/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-20 23:03:40,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:03:40,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:03:40,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 65403148c07c561bce9cf55676881f92: 2023-09-20 23:03:40,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695250881756.65403148c07c561bce9cf55676881f92. 2023-09-20 23:03:40,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/namespace/c72413fec41daeda57cd9b7e6e2e810b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-20 23:03:40,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:03:40,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:03:40,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c72413fec41daeda57cd9b7e6e2e810b: 2023-09-20 23:03:40,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695250880998.c72413fec41daeda57cd9b7e6e2e810b. 2023-09-20 23:03:40,513 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/.tmp/rep_barrier/00767617159a48d0a8fc50960736246b 2023-09-20 23:03:40,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00767617159a48d0a8fc50960736246b 2023-09-20 23:03:40,522 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-20 23:03:40,526 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/.tmp/table/63b92eeb1feb45ccb4083d16c22bb3af 2023-09-20 23:03:40,530 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63b92eeb1feb45ccb4083d16c22bb3af 2023-09-20 23:03:40,531 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/.tmp/info/4e197e1798a643839285a43f8865e779 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/info/4e197e1798a643839285a43f8865e779 2023-09-20 23:03:40,535 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e197e1798a643839285a43f8865e779 2023-09-20 23:03:40,535 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/info/4e197e1798a643839285a43f8865e779, entries=48, sequenceid=131, filesize=10.3 K 2023-09-20 23:03:40,536 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/.tmp/rep_barrier/00767617159a48d0a8fc50960736246b as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/rep_barrier/00767617159a48d0a8fc50960736246b 2023-09-20 23:03:40,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00767617159a48d0a8fc50960736246b 2023-09-20 23:03:40,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/rep_barrier/00767617159a48d0a8fc50960736246b, entries=13, sequenceid=131, filesize=6.4 K 2023-09-20 23:03:40,541 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/.tmp/table/63b92eeb1feb45ccb4083d16c22bb3af as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/table/63b92eeb1feb45ccb4083d16c22bb3af 2023-09-20 23:03:40,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63b92eeb1feb45ccb4083d16c22bb3af 2023-09-20 23:03:40,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/table/63b92eeb1feb45ccb4083d16c22bb3af, entries=24, sequenceid=131, filesize=6.9 K 2023-09-20 23:03:40,548 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 113ms, sequenceid=131, compaction requested=false 2023-09-20 23:03:40,557 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-20 23:03:40,558 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-20 23:03:40,558 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-20 23:03:40,559 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-20 23:03:40,559 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-20 23:03:40,559 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-20 23:03:40,590 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 23:03:40,590 INFO [RS:2;jenkins-hbase4:42935] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42935,1695250878960; zookeeper connection closed. 2023-09-20 23:03:40,590 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:42935-0x100cb92c0690003, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 23:03:40,590 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@69d0f148] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@69d0f148 2023-09-20 23:03:40,634 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35407,1695250878922; all regions closed. 2023-09-20 23:03:40,636 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35755,1695250878873; all regions closed. 2023-09-20 23:03:40,641 DEBUG [RS:1;jenkins-hbase4:35407] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/oldWALs 2023-09-20 23:03:40,641 INFO [RS:1;jenkins-hbase4:35407] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35407%2C1695250878922:(num 1695250880598) 2023-09-20 23:03:40,641 DEBUG [RS:1;jenkins-hbase4:35407] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:03:40,641 INFO [RS:1;jenkins-hbase4:35407] regionserver.LeaseManager(133): Closed leases 2023-09-20 23:03:40,642 INFO [RS:1;jenkins-hbase4:35407] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-20 23:03:40,642 INFO [RS:1;jenkins-hbase4:35407] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-20 23:03:40,642 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-20 23:03:40,642 INFO [RS:1;jenkins-hbase4:35407] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-20 23:03:40,642 INFO [RS:1;jenkins-hbase4:35407] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-20 23:03:40,643 INFO [RS:1;jenkins-hbase4:35407] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35407 2023-09-20 23:03:40,644 DEBUG [RS:0;jenkins-hbase4:35755] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/oldWALs 2023-09-20 23:03:40,644 INFO [RS:0;jenkins-hbase4:35755] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35755%2C1695250878873.meta:.meta(num 1695250880722) 2023-09-20 23:03:40,644 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:03:40,644 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35407,1695250878922 2023-09-20 23:03:40,645 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 23:03:40,646 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35407,1695250878922] 2023-09-20 23:03:40,646 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35407,1695250878922; numProcessing=2 2023-09-20 23:03:40,647 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35407,1695250878922 already deleted, retry=false 2023-09-20 23:03:40,647 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35407,1695250878922 expired; onlineServers=1 2023-09-20 23:03:40,649 DEBUG [RS:0;jenkins-hbase4:35755] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/oldWALs 2023-09-20 23:03:40,649 INFO [RS:0;jenkins-hbase4:35755] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35755%2C1695250878873:(num 1695250880598) 2023-09-20 23:03:40,649 DEBUG [RS:0;jenkins-hbase4:35755] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:03:40,649 INFO [RS:0;jenkins-hbase4:35755] regionserver.LeaseManager(133): Closed leases 2023-09-20 23:03:40,649 INFO [RS:0;jenkins-hbase4:35755] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-20 23:03:40,649 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-20 23:03:40,650 INFO [RS:0;jenkins-hbase4:35755] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35755 2023-09-20 23:03:40,655 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-20 23:03:40,655 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35755,1695250878873 2023-09-20 23:03:40,656 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35755,1695250878873] 2023-09-20 23:03:40,656 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35755,1695250878873; numProcessing=3 2023-09-20 23:03:40,657 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35755,1695250878873 already deleted, retry=false 2023-09-20 23:03:40,657 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35755,1695250878873 expired; onlineServers=0 2023-09-20 23:03:40,657 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45915,1695250877567' ***** 2023-09-20 23:03:40,657 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-20 23:03:40,657 DEBUG [M:0;jenkins-hbase4:45915] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dc8e968, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-20 23:03:40,657 INFO [M:0;jenkins-hbase4:45915] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45915,1695250877567 2023-09-20 23:03:40,657 INFO [M:0;jenkins-hbase4:45915] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45915,1695250877567; all regions closed. 2023-09-20 23:03:40,657 DEBUG [M:0;jenkins-hbase4:45915] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-20 23:03:40,657 DEBUG [M:0;jenkins-hbase4:45915] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-20 23:03:40,658 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-20 23:03:40,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695250880215] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695250880215,5,FailOnTimeoutGroup] 2023-09-20 23:03:40,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695250880215] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695250880215,5,FailOnTimeoutGroup] 2023-09-20 23:03:40,658 DEBUG [M:0;jenkins-hbase4:45915] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-20 23:03:40,658 INFO [M:0;jenkins-hbase4:45915] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-20 23:03:40,658 INFO [M:0;jenkins-hbase4:45915] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-20 23:03:40,658 INFO [M:0;jenkins-hbase4:45915] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-20 23:03:40,658 DEBUG [M:0;jenkins-hbase4:45915] master.HMaster(1512): Stopping service threads 2023-09-20 23:03:40,658 INFO [M:0;jenkins-hbase4:45915] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-20 23:03:40,658 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-20 23:03:40,658 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-20 23:03:40,658 ERROR [M:0;jenkins-hbase4:45915] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-16,5,PEWorkerGroup] 2023-09-20 23:03:40,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-20 23:03:40,659 INFO [M:0;jenkins-hbase4:45915] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-20 23:03:40,659 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-20 23:03:40,659 DEBUG [M:0;jenkins-hbase4:45915] zookeeper.ZKUtil(398): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-20 23:03:40,659 WARN [M:0;jenkins-hbase4:45915] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-20 23:03:40,659 INFO [M:0;jenkins-hbase4:45915] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-20 23:03:40,660 INFO [M:0;jenkins-hbase4:45915] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-20 23:03:40,660 DEBUG [M:0;jenkins-hbase4:45915] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-20 23:03:40,660 INFO [M:0;jenkins-hbase4:45915] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 23:03:40,660 DEBUG [M:0;jenkins-hbase4:45915] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 23:03:40,660 DEBUG [M:0;jenkins-hbase4:45915] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-20 23:03:40,660 DEBUG [M:0;jenkins-hbase4:45915] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 23:03:40,660 INFO [M:0;jenkins-hbase4:45915] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.86 KB heapSize=452.09 KB 2023-09-20 23:03:40,673 INFO [M:0;jenkins-hbase4:45915] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.86 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3bafb2f8b71f4d4e952b708fa97c2854 2023-09-20 23:03:40,677 INFO [M:0;jenkins-hbase4:45915] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bafb2f8b71f4d4e952b708fa97c2854 2023-09-20 23:03:40,677 DEBUG [M:0;jenkins-hbase4:45915] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3bafb2f8b71f4d4e952b708fa97c2854 as hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3bafb2f8b71f4d4e952b708fa97c2854 2023-09-20 23:03:40,681 INFO [M:0;jenkins-hbase4:45915] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bafb2f8b71f4d4e952b708fa97c2854 2023-09-20 23:03:40,681 INFO [M:0;jenkins-hbase4:45915] regionserver.HStore(1080): Added hdfs://localhost:37461/user/jenkins/test-data/de36f474-8c24-c4aa-7623-46ad0f6c7611/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3bafb2f8b71f4d4e952b708fa97c2854, entries=119, sequenceid=899, filesize=28.7 K 2023-09-20 23:03:40,682 INFO [M:0;jenkins-hbase4:45915] regionserver.HRegion(2948): Finished flush of dataSize ~375.86 KB/384876, heapSize ~452.08 KB/462928, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-09-20 23:03:40,683 INFO [M:0;jenkins-hbase4:45915] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-20 23:03:40,683 DEBUG [M:0;jenkins-hbase4:45915] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-20 23:03:40,687 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-20 23:03:40,687 INFO [M:0;jenkins-hbase4:45915] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-20 23:03:40,687 INFO [M:0;jenkins-hbase4:45915] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45915 2023-09-20 23:03:40,690 DEBUG [M:0;jenkins-hbase4:45915] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45915,1695250877567 already deleted, retry=false 2023-09-20 23:03:40,746 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 23:03:40,746 INFO [RS:1;jenkins-hbase4:35407] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35407,1695250878922; zookeeper connection closed. 2023-09-20 23:03:40,746 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35407-0x100cb92c0690002, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 23:03:40,746 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@69fea8b1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@69fea8b1 2023-09-20 23:03:40,846 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 23:03:40,846 INFO [M:0;jenkins-hbase4:45915] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45915,1695250877567; zookeeper connection closed. 2023-09-20 23:03:40,846 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): master:45915-0x100cb92c0690000, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 23:03:40,946 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 23:03:40,946 INFO [RS:0;jenkins-hbase4:35755] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35755,1695250878873; zookeeper connection closed. 2023-09-20 23:03:40,947 DEBUG [Listener at localhost/33567-EventThread] zookeeper.ZKWatcher(600): regionserver:35755-0x100cb92c0690001, quorum=127.0.0.1:53756, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-20 23:03:40,947 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@52f6080e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@52f6080e 2023-09-20 23:03:40,947 INFO [Listener at jenkins-hbase4.apache.org/44443] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-20 23:03:40,947 WARN [Listener at jenkins-hbase4.apache.org/44443] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-20 23:03:40,951 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-20 23:03:41,054 WARN [BP-794373270-172.31.14.131-1695250873816 heartbeating to localhost/127.0.0.1:37461] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-20 23:03:41,054 WARN [BP-794373270-172.31.14.131-1695250873816 heartbeating to localhost/127.0.0.1:37461] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-794373270-172.31.14.131-1695250873816 (Datanode Uuid a768f595-0875-4b6c-bc0c-4f1b8a1014cc) service to localhost/127.0.0.1:37461 2023-09-20 23:03:41,056 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data5/current/BP-794373270-172.31.14.131-1695250873816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 23:03:41,057 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data6/current/BP-794373270-172.31.14.131-1695250873816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 23:03:41,058 WARN [Listener at jenkins-hbase4.apache.org/44443] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-20 23:03:41,059 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-20 23:03:41,162 WARN [BP-794373270-172.31.14.131-1695250873816 heartbeating to localhost/127.0.0.1:37461] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-20 23:03:41,162 WARN [BP-794373270-172.31.14.131-1695250873816 heartbeating to localhost/127.0.0.1:37461] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-794373270-172.31.14.131-1695250873816 (Datanode Uuid 1d459a81-2e3f-429b-8103-a00b3d7a2239) service to localhost/127.0.0.1:37461 2023-09-20 23:03:41,163 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data3/current/BP-794373270-172.31.14.131-1695250873816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 23:03:41,163 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data4/current/BP-794373270-172.31.14.131-1695250873816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 23:03:41,164 WARN [Listener at jenkins-hbase4.apache.org/44443] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-20 23:03:41,166 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-20 23:03:41,269 WARN [BP-794373270-172.31.14.131-1695250873816 heartbeating to localhost/127.0.0.1:37461] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-20 23:03:41,269 WARN [BP-794373270-172.31.14.131-1695250873816 heartbeating to localhost/127.0.0.1:37461] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-794373270-172.31.14.131-1695250873816 (Datanode Uuid 3c0b6b46-462d-46ed-b715-ae152a4a590a) service to localhost/127.0.0.1:37461 2023-09-20 23:03:41,270 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data1/current/BP-794373270-172.31.14.131-1695250873816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 23:03:41,270 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d465e21d-e269-6c1f-fbb0-c88e1f6a7492/cluster_d386def4-e770-430e-79c2-c8fa2e04e96d/dfs/data/data2/current/BP-794373270-172.31.14.131-1695250873816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-20 23:03:41,291 INFO [Listener at jenkins-hbase4.apache.org/44443] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-20 23:03:41,417 INFO [Listener at jenkins-hbase4.apache.org/44443] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-20 23:03:41,512 INFO [Listener at jenkins-hbase4.apache.org/44443] hbase.HBaseTestingUtility(1293): Minicluster is down